llm议题
RT @0xp1ain: Researcher A discovers a critical vulnerability using IDA and pwntools → This is recognized as Researcher A’s technical achievement, made possible by their ability to effectively use the right tools 🎉
Researcher A discovers a critical vulnerability using an LLM → This is also Researcher A’s technical achievement, made possible by their ability to effectively apply the right heuristics and tools. So why is it that, in this case, people say the discovery was only possible because of the LLM or the harness? 🤣
Simply using an LLM doesn’t change who deserves credit for the technical achievement. of course, LLMs can enable researchers to achieve performance or speed improvements that were previously impossible, sometimes by 5x or even 10x
But when an extremely difficult, critical vulnerability is discovered, I believe the credit should go not to the LLM itself, but to the human researcher who skillfully directed it