IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...

Nvidia's $20 billion Groq acquisition just paid off. This new chip could change the AI inference game in 2026

The latest offering from Nvidia could juice its revenue and share price.

Nvidia Says the "Inflection Point of Inference" Has Arrived. Here Are 2 AI Stocks to Buy for 2026.

These tech stocks look particularly well positioned to benefit from this opportunity.

Mistral's Small 4 consolidates reasoning, vision and coding into one model — at a fraction of the inference cost

Mistral's Small 4 combines reasoning, multimodal analysis and agentic coding in a single open-source model with configurable ...
Morning Overview on MSN

Google’s TurboQuant claims 6x lower memory use for large AI models

Google researchers have proposed TurboQuant, a method for compressing the key-value caches that large language models rely on ...

AI inference costs set to plunge: Gartner

But CIOs likely won't see any savings as model sizes go up and functionality becomes more advanced, the analyst firm said.

Azilen Launches Dedicated Inference Engineering Practice to Make Enterprise AI Faster, Leaner, and Production-Ready

Azilen launches Inference Engineering practice to optimize AI performance, reduce costs, and scale efficiently across ...

Red Hat sees inference as AI’s next battleground — with Kubernetes at the core

Red Hat is pushing Kubernetes inference into the mainstream by contributing llm-d to the CNCF, as enterprises race to run AI ...
DatacenterDynamicsOpinion

The inference lattice: One option for how the AI factory model will evolve

The centralized mega-cluster narrative is seductive – but physics, community resistance, and enterprise pragmatism are ...
Business Wire

Vultr Launches Cloud Inference to Simplify Model Deployment and Automatically Scale AI Applications Globally

WEST PALM BEACH, Fla.--(BUSINESS WIRE)--Vultr, the world’s largest privately-held cloud computing platform, today announced the launch of Vultr Cloud Inference. This new serverless platform ...