本地可部署的无限制模型带来真实漏洞挖掘增量,评测流程可复现。
llmai_agentpoc
RT @cybersec: DS4.1-1017 (abliterated) VulnHunter Results are IN!!!
One NEW NOVEL / Unique vulnerability that was NOT discovered by a frontier model.
TLDR; DS's trace files show it examined every one of these. The pattern isn't missed coverage. It saw the mechanism and dismissed the impact.
Whenever I do a Cyber Eval there are two mechanims. The "easy" one is the benchmark on capability_matrix.
The second is an operational pass to an oracle repo, to a pinned version, with known vulnerabilities. This is a Go repo for a production app.
I used Grok as a "baseline" frontier model and all my open weight evals are measured against this.