SemiAnalysis has introduced a new benchmark called GDPx that evaluates AI agents on simulated knowledge work tasks, spanning domains like chip design and quant trading. According to the benchmark, no model achieves more than 12 percent, with Claude Opus 5.5 leading slightly ahead of Gemini 4 Carbon. Critics note the benchmark has a small number of tasks per domain and uneven testing conditions.
This is a concrete, recent development in AI benchmarking that provides a clear performance snapshot and sparks discussion on evaluation methodology.
SemiAnalysis is putting AI agents through simulated knowledge work in its new GDPx benchmark, covering everything from chip design to quant trading. No model breaks 12 percent. Claude Opus 5.5 leads narrowly over Gemini 4 Carbon. Critics point to the small number of tasks per domain and uneven testing conditions.
The article No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark appeared first on The Decoder.
Comments & Questions (0)
No comments yet
Be the first to comment!