权重级定向篡改可改变模型行为,是模型完整性的现实威胁样本。
llm模型篡改研究
RT @HaozeHe_Hector: We edited 0.0002% of NanoJev’s weights, and the edited model beat the original 65–34 (1 draw) in 100 head-to-head Tank War games. 🎯
The original took only about 1 in 3 clean shots. Using Weight-Space Programming by @rikiyatakehi et al. (https://t.co/oQW1HI5rU9), we read the fire-vs-hold direction out of its activations and added it to the decision head: 1,024 weights, no training. Now it takes every clean shot and fires about twice as often.
It isn’t a better shot, though. It just stopped hesitating.
🛠️ Weight editing is now a trainer in Honing. An edit goes through the same gate as SFT and RL, and only ships if it beats the current model.
Report: https://t.co/xpLcLMauje
Weight-edit trainer: https://t.co/hoXdxumA1s
GitHub: https://t.co/oAPAOkCpcy
Follow @HoningLab for more Honing updates :)