#ai infrastructure
Ai Infrastructure: 58 AI articles covering ai infrastructure news, analysis, and research
Articles
Redis LangCache: Managed Semantic Cache Cuts LLM API Costs by Up to 90% and Delivers Cache Hits 15x FasterNEWβ8
Redis LangCache is a managed semantic cache that matches prompts by meaning, cutting LLM API costs up to 90% and returning cache hits 15x faster.
Jensen Huang Explains Why Nvidia Expects 70% Revenue Growth Next YearNEWβ9
Jensen Huang explains why Nvidia expects 70% revenue growth next year, defying skeptics as competition in AI chips intensifies from hyperscalers and startups.
OpenAI Pauses $200 Pro Subscriptions as Demand for Astra Model Strains InfrastructureNEWβ7
OpenAI pauses new $200/month Pro subscriptions as demand for its new Astra model strains infrastructure. Existing users keep access while OpenAI manages the sur...
DeepSeek-V4.1-Flash Launches with 1M Context, FP4 KV Cache, and Cross-Layer Attention ReuseNEWβ9
DeepSeek-V4.1-Flash launches with 1M context, FP4 KV cache, and cross-layer attention reuseβcutting KV memory to 890 bytes per token for input-heavy agent workl...
NVIDIA Unveils CUDA Rust with cuda-oxide and cutile-rs for Compile-Time-Safe GPU Kernelsβ8
NVIDIA introduces CUDA Rust with cuda-oxide and cutile-rs, enabling compile-time-safe GPU kernels in Rust and boosting memory safety for AI development.
Mistral Raises β¬3B as Sovereign AI Becomes Big Businessβ9
Mistral AI raises β¬3B to scale compute, expand globally, and position itself as a sovereign AI leader amid European tech independence efforts.
IFM Unveils K2 Horizon: Six Apache 2.0 Models from 0.9B to 375Bβ8
IFM launches K2 Horizon: six Apache 2.0 models from 0.9B to 375B-A23B with open weights, training data, and code for fully transparent AI development.
Perplexity Details Its GPU Embedding Stack: How Ivy, Tulip, and ROSE Power pplx-embedβ8
Perplexity details its GPU embedding stack, revealing how Ivy, Tulip, and ROSE power efficient pplx-embed serving and ranking across search and API platforms.
AI Compute Startup Nscale Seeks $3.5B in Pre-IPO Funding Ahead of Potential September Listingβ7
AI startup Nscale seeks $3.5B in pre-IPO funding, targeting a September listing amid major AI compute deals.
Crusoe Raises $3B at $30B Valuation, Eyes IPOβ8
Crusoe raises $3B at a $30B valuation, signaling AI data center demand. Eyes IPO after major Meta, Microsoft, OpenAI contracts.