⚡Megatron LLM Hub
←Back to search
Twitter

用本地 DGX Spark 跑开源模型做安全研究,折算 token 成本已低于前沿 API

前沿模型会拒绝的安全任务在本地模型上可执行,是自托管的实际收益样本。
本地部署llm成本
RT @Void_Sec: I asked GPT to quantify how much I 'd have paid in API token costs for my last 15 days of work on my DGX Spark cluster. Turns out, A LOT. The cluster is already paying for itself, especially considering that the cybersecurity work I did would have been blocked on frontier models https://t.co/hY1PNRNUqf