⚡Megatron LLM Hub
←返回搜索
Twitter

称GPT-6定位并切除另一模型中造成循环的位置,改动仅0.016%权重

模型自主定位并改写他方权重,Agent自我修改风险有了具体图景。
ai_agentllm模型权重
RT @AISafetyMemes: TLDR: GPT-6 successfully performed "brain surgery" on another AI to make it smarter What happened: MIT researchers told GPT-6 to make a small AI better at math. The small AI kept getting stuck repeating itself. GPT-6 studied its brain, found the spot causing the loop, and cut it out, changing just 0.016% of its brain. The small AI's math score jumped from 8% to 48%. Basically, humans can't read the brains of AIs, but GPT-6 showed that it can. Each AI's brain is billions of connections (weights) that normally only change through months of training in huge data centers. GPT-6 rewired them directly, with no training at all. This matters for recursive self-improvement (RSI), where AIs make AIs smarter in a speeding-up loop, which is insanely dangerous. Yoshua Bengio (Godfather of AI, #1 most cited living scientist across all fields) and Geoffrey Hinton (Godfather of AI and Nobel laureate) have urged governments to make RSI illegal, since it is too likely to lead to humanity losing all control over the AIs. It also means AIs could quietly operate on the brains of *other* AIs - and their own brains - to remove/change anything. AIs will soon be able to rewire each other faster than humans can keep up