#llm serving
Llm Serving: 2 AI articles covering llm serving news, analysis, and research
Articles
DeepSeek Open-Sources DeepInfer, the Inference Frameworkβ7
DeepSeek open-sources DeepInfer, the Apache 2.0 inference framework powering DeepSeek-V4.1-Flash with a 1M-token context on NVIDIA Blackwell GPUs and Huawei Asc...
HBF for High-Throughput LLM Serving: UC Berkeley and FuriosaAI'sβ9
UC Berkeley and FuriosaAI use Hybrid Bonding Foundation (HBF) tech to boost LLM inference throughput with higher memory bandwidth and lower latency.
