⚡Megatron LLM Hub
←Back to search
Twitter

DeepSeek 开源生产级推理框架 DeepInfer

自托管 LLM 推理栈又多一个可落地的开源选项。
llm工具推理
RT @deepseek_ai: 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4