SoK: Assessing the Evolution of LLM Capability in Software Vulnerability Research
This systematization of knowledge introduces a framework that rates LLM vulnerability-research capabilities on an autonomy scale modeled on driving-automation levels and qualifies claims by correctness, availability and evidence strength. It reports that agents discovered, validated and patched vulnerabilities in real-world software without human intervention before the restricted frontier models of 2026, with open-weight models later reaching comparable autonomy for discovery and validation. Across a decade of public vulnerability records, the authors observe that disclosed vulnerabilities more than doubled in 2026, with a growing share rated critical or high, while the time between report-to-fix and disclosure-to-attack stages has not shifted noticeably. The paper also grades proposed mitigations with an explicit rubric and derives guidance for stakeholder groups.