CWE-bench v2: More coverage, quality, and transparency
Hugging Face released CWE-bench v2, an updated benchmark for evaluating AI agents on real-world software vulnerabilities. The new version expands coverage to 25 CWE categories, improves data quality through manual curation, and adds transparency features like per-sample metadata and leaderboard filtering. This update aims to provide a more reliable and comprehensive evaluation for AI-driven security tools.
Why it matters: Provides concrete details on a new benchmark version, directly useful for AI security researchers and developers evaluating agent performance.