⚡Megatron LLM Hub
←Back to search
Twitter

介绍 Cerebras 如何把万亿参数模型放进片上内存并横向扩展。

llm基础设施
RT @seanlie: How we deploy multi-trillion parameter models at scale Today, let's break down the math for how @cerebras: 1. Fits the full model into on-chip memory 2. Maps the model across multiple chips 3. Handles a high # of concurrent requests