DeepSeek: Further Open-Sourcing Its Internal Inference Framework DeepInfer
Oct 20, 17:08
On October 20, citing CLS, DeepSeek stated it has achieved high-throughput, low-latency large-scale inference services for DeepSeek V4.1 Flash based on DeepInfer. Going forward, the inference code for DeepSeek's new models and subsequent optimizations will also be continuously updated here.