⚡Megatron LLM Hub
←Back to search
Twitter

DeepSeek 开源其内部推理框架 DeepInfer

llm自托管工具
RT @deepseek_ai: 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4