工具推理
RT @jino_rohit: im building noro - a image and video inference library. it is built on top of huggingface diffusers with a focus on performance.
i currently have the krea-2 model implemented and across all image dimensions, on average we have a 20% speedup. im currently building it for nvidia chips and also extending to amd as well.
all the kernels and tricks are written in triton and gluon!
repo link in the comments.