#inference optimization
Inference Optimization: 3 AI articles covering inference optimization news, analysis, and research
Articles
Baidu's ERNIE Evolve Automated Research System OutperformsNEW⭐9
Baidu's ERNIE Evolve autonomous research system beats public benchmarks and delivers +33.7% inference throughput on ERNIE-5.5-Flash. Here's how it works.
KVBoost: Deviation-Guided Chunk-Level KV Cache Reuse for⭐8
KVBoost enables chunk-level KV cache reuse for LLMs, cutting time-to-first-token by 4.49x with 16% gains over prefix caching.
Up to 3.2x Faster Inference with LFM2.5-DSpark⭐8
Discover LiquidAI's LFM2.5-DSpark: 3.2x faster inference with sparse MoE, low active parameters, and real-time edge deployment compatibility.