Back to AI News
arxiv

AnalogLayoutWorld: A New Benchmark for Agentic Analog Layout Design

AnalogLayoutWorld is an open-source benchmark with 40 expert-reviewed tasks for end-to-end analog circuit layout generation from fixed transistor-level netlists. It integrates a design environment with physical and post-layout electrical verification and objective layout quality metrics. Across 13 model-harness configurations, 91.1% of attempts produce GDS layouts but only 23.0% meet acceptance criteria, with the internally developed Novara agent achieving the highest aggregate score. The analysis suggests reasoning efficiency and effective use of verification feedback are key to sustaining quality as task complexity grows.

AI Brief

This introduces a concrete, open benchmark for evaluating AI agents on long-horizon physical engineering tasks, with quantitative results and a new state-of-the-art agent system.

arXiv:2611.16991v1 Announce Type: new Abstract: Coding agents have demonstrated strong capabilities in software development, yet their ability to tackle long-horizon engineering tasks governed by physical constraints remains less understood. We study this question through analog circuit layout, which demands domain knowledge, geometric reasoning, and iterative interaction with design and verification tools. We introduce \textbf{AnalogLayoutWorld}, an open-source agent benchmark with 40 expert-reviewed tasks for end-to-end layout generation from fixed transistor-level netlists. It combines an integrated design environment with independent physical and post-layout electrical verification, as well as objective layout quality metrics co-designed with analog layout experts. Across 13 model--harness configurations, 91.1\% of attempts produce GDS layouts, but only 23.0\% satisfy the benchmark's acceptance criteria. We also evaluate Novara, an internally developed agent system, which achieves the highest reported aggregate score. Our analysis links performance differences to test-time scaling under fixed budgets, suggesting that reasoning efficiency and effective use of verification feedback help sustain design quality as task complexity grows.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!