AI 找漏洞的能力边界之争,决定后续该往哪投入。
形式化验证llm议题
uhm... i think this seems like the wrong approach, especially if the goal is to formally verify every piece of software we have and eliminate every bug, we should definitely formally verify lots of software but "everything"???
first of all, how do you even deal with state explosion and the sheer complexity of real world software and its dependencies? are you really sure mythos 8 or gpt-8 won't find flaws in your proofs, specs, or assumptions? how do you even specify the behavior of nondeterministic agents, especially you have to balanced against usability?
i don't think the goal should be eliminating vulnerabilities or proving their absence. that's not going to happen at the scale and complexity of real world software.
start by assuming vulnerabilities are inevitable, then build around that assumption. reduce attack surfaces, isolate critical systems, and make exploitation as difficult as possible.
i think thinking cyber is just fixing vulnerabilities might not be a great idea.