Research Editor selected
Alibaba’s Co-Design Bench Exposes Gaps in AI Coding Agents
Alibaba introduced Co-Design Bench, a benchmark based on real user requests that coding agents previously failed in practice. The top-performing model, GPT-6 Astra, fully solved 26.4% of tasks, despite the same models scoring above 99% on older benchmarks. The results suggest established evaluations may substantially overstate coding-agent reliability in real-world workflows.
Why it matters: The benchmark offers useful evidence that current coding-agent scores may not reflect how much human cleanup practical tasks require.
Co-Design BenchAI coding agentsbenchmark reliability