Google's TurboQuant compression tech cuts LLM memory use by 6x with no accuracy loss

The biggest memory burden for LLMs is the key-value cache, which stores conversational context as users interact with AI ...
DIGITIMES

In-depth: Google TurboQuant cuts LLM memory 6x, resets AI inference cost curve

Google has introduced TurboQuant, a compression algorithm that reduces large language model (LLM) memory usage by at least 6x ...

This Google AI Breakthrough Could End the Global RAM Crisis Sooner Than Expected

The post This Google AI Breakthrough Could End the Global RAM Crisis Sooner Than Expected appeared first on Android Headlines ...

Google AI breakthrough shows why we don't need more data centers

That much was clear in 2025, when we first saw China's DeepSeek — a slimmer, lighter LLM that required way less data center ...

IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...
Ars Technica

OpenAI brings plugins to Codex, closing some of the gap with Claude Code

OpenAI has added plugin support to its agentic coding app Codex in an apparent attempt to match similar features offered by competitors Anthropic (in Claude Code) and Google (in Gemini’s command line ...