⚡Megatron LLM Hub
←Back to search
Twitter

单张 3090 跑 Qwen3.8-Flash-Next,llamAmpere 称吞吐优于 Strata

llm本地部署性能
RT @QwenAIFans: 🔥 One 3090 just beat Strata on Qwen3.8-Flash-Next. llamAmpere v0.6.3: 120+ tok/s, >3K/s prompt. 12% faster than Strata, 27% lower error than Unsloth Dynamic v3.1 3XXS. Caveat: author's AmpereInteger+ bench on his 3090+64GB. via @JakeKAllDay 👇 https://t.co/idin9xLOQb https://t.co/bLoBAt8Vqh