llm本地部署性能
RT @QwenAIFans: 🔥 One 3090 just beat Strata on Qwen3.8-Flash-Next.
llamAmpere v0.6.3: 120+ tok/s, >3K/s prompt. 12% faster than Strata, 27% lower error than Unsloth Dynamic v3.1 3XXS.
Caveat: author's AmpereInteger+ bench on his 3090+64GB.
via @JakeKAllDay 👇
https://t.co/idin9xLOQb https://t.co/bLoBAt8Vqh