本地跑更大开源模型的硬件门槛下降,自托管推理成本结构改变。
固件ai_agent硬件
RT @LLMJunky: 5090 firmware has finally been unlocked
96GB upgrades are coming.
If you're interested in GPUs and modification and you're not following Greg, you should probably change that.
He is among the only people in the United States performing these types of modifications, which is a big deal.
One of the biggest reasons that people don't order modified cards is because they are afraid they will have no support or warranty once it leaves China, which is most likely true.