DeepSeek Open-Sources DeepInfer, the Inference Framework Powering DeepSeek-V4.1-Flash
DeepSeek has open-sourced DeepInfer, the inference framework that runs its production services. The DeepSeek DeepInfer inference framework is the engine behind DeepSeek-V4.1-Flash and ships under the Apache 2.0 license. DeepSeek also released deepseek-recipe, its MIT-licensed token encoding and decoding layer. For developers, this is a rare look at a frontier lab's real serving stack.
TL;DR
- Size / scope: One supported model (DeepSeek-V4.1-Flash), with a 1M-token context window per the model card.
- Runs on: NVIDIA SM100 (Blackwell) GPUs and Huawei Ascend 950 NPUs. Benchmarks used 4 GPUs for prefill and 64 for decode.
- Performance: Details to follow in the full analysis below.
via MarkTechPost