⚡Megatron LLM Hub
←返回搜索
Twitter

NVIDIA公布Rubin NVL72上Kimi K3的推理吞吐数据

llm推理硬件
RT @SemiAnalysis_: BREAKING NEWS🚨: NVIDIA just submitted its first Rubin NVL72 Kimi K3 submission, and it can reach over 850 tok/s/user, even at 2.8 Trillion parameters, with over 3x higher throughput on @vllm_project! Great work by the NVIDIA team, and excited for Rubin Software 1.0 GA coming soon!