显示低成本模型已能批量复现真实 CVE,本地部署漏洞挖掘的门槛随之下降。
llmai_agentpoc报告
RT @pilvar222: Unsurprisingly, DeepSeek V4.1 Flash 1017 is mogging all other models on our cybersecurity benchmark
- At pass@3, it rediscovered 87.5% of the benchmark CVEs (28/32). That ties DeepSeek V4 Pro 0813 for 2nd place, behind only GPT-6 Astra (90.6%)
- Single-run recall is 70.8%, matching Opus 5 and Grok 4.7. The previous Flash was at 65.6%
- Precision went from 78.9% to 86.4%, so most false positives are now gone
Cost: $2.40 per CVE found. That’s 27x cheaper than Opus 5 ($64.96) and 56x cheaper than Astra ($135.23)
@deepseek_ai keeps pushing the Pareto frontier
1/4 🧵