本地跑模型时定位显存占用来源的开源小工具,可即刻上手。
工具llm
RT @tomshardware: Open-source GPU task manager reveals exactly what's eating your VRAM — Microsoft VP's new GPU Taskman tool reveals every process using your GPU, how much memory each uses, and breaks down AI and LLM workloads https://t.co/ikzOnWrp3P