Sandisk and SK hynix push High Bandwidth Flash (HBF) standard via OCP to cut AI inference costs and boost scalability.

SK hynix Inc. (or "the company",  and Sandisk Corporation held 'HBF Spec. Standardization Consortium Kick-Off' event at Sandisk Headquarters in Milpitas, California on the 25 th (local time) ...

Upstart's 5th-gen RDU aims to undercut Nvidia's B200 on speed and cost AI infrastructure company SambaNova has raised $350 ...

The shift from training-focused to inference-focused economics is fundamentally restructuring cloud computing and forcing ...

Generative AI is arguably the most complex application that humankind has ever created, and the math behind it is incredibly complex even if the results are simple enough to understand. GenAI also it ...

An analog in-memory compute chip claims to solve the power/performance conundrum facing artificial intelligence (AI) inference applications by facilitating energy efficiency and cost reductions ...

“The rapid growth of LLMs has revolutionized natural language processing and AI analysis, but their increasing size and memory demands present significant challenges. A common solution is to spill ...

A new technical paper titled “Hardware-based Heterogeneous Memory Management for Large Language Model Inference” was published by researchers at KAIST and Stanford University. “A large language model ...

Micron Technology is poised for explosive growth, driven by surging AI demand and its dominant position in high-bandwidth memory for leading GPUs. MU's HBM products are sold out through 2025, with ...

Microsoft’s new Maia 200 inference accelerator chip enters this overheated market with a new chip that aims to cut the price ...

Samsung Electronics rose 3.63% on Tuesday in South Korea. Analysts say surging memory prices and sustained AI demand could push the chipmaker’s market value toward $1 trillion.