⚡Megatron LLM Hub
←返回搜索
Twitter

只改 1024 个权重、不经训练即让 Tank War 模型大幅改变开火策略。

权重级定向篡改可改变模型行为,是模型完整性的现实威胁样本。
llm模型篡改研究
RT @HaozeHe_Hector: We edited 0.0002% of NanoJev’s weights, and the edited model beat the original 65–34 (1 draw) in 100 head-to-head Tank War games. 🎯 The original took only about 1 in 3 clean shots. Using Weight-Space Programming by @rikiyatakehi et al. (https://t.co/oQW1HI5rU9), we read the fire-vs-hold direction out of its activations and added it to the decision head: 1,024 weights, no training. Now it takes every clean shot and fires about twice as often. It isn’t a better shot, though. It just stopped hesitating. 🛠️ Weight editing is now a trainer in Honing. An edit goes through the same gate as SFT and RL, and only ships if it beats the current model. Report: https://t.co/xpLcLMauje Weight-edit trainer: https://t.co/hoXdxumA1s GitHub: https://t.co/oAPAOkCpcy Follow @HoningLab for more Honing updates :)