⚡Megatron LLM Hub
←返回搜索
Twitter

指出 ROCm 编译器不生成 RDNA2 的 int8 DP4a 指令,需内联汇编调用

硬件
RT @bitflipgremlin: @unixpickle you'd be surprised how bad GPU drivers and tooling are. RDNA2 has int8 DP4a support builtin but the ROCm compiler refuses to emit the instruction so you need to call it through inline assembly, for example