⚡Megatron LLM Hub
←返回搜索
Twitter

noro:基于diffusers的图像视频推理库,Triton内核平均提速约20%

工具推理
RT @jino_rohit: im building noro - a image and video inference library. it is built on top of huggingface diffusers with a focus on performance. i currently have the krea-2 model implemented and across all image dimensions, on average we have a 20% speedup. im currently building it for nvidia chips and also extending to amd as well. all the kernels and tricks are written in triton and gluon! repo link in the comments.