Back to AI News
arxiv

OmniQ and Residual Agents: A self-improving AI scientist for computational quantum research

The paper introduces OmniQ, a virtual research environment that converts published computational quantum science papers into executable reproduction tasks, and evaluates five agentic systems across 59 papers. It finds that current AI scientists frequently fail to reproduce published results due to a mismatch between paper content and agent requirements. The authors develop Residual Agents (RA), a quantum-tailored self-improving AI scientist that distills verified workflow repairs, boosting DeepSeek V4.1 Flash from 68% to 85% accuracy at one-third the cost of Claude Code with Opus 5.

AI Brief

Provides a concrete, reproducible framework and a cost-effective solution to the reproducibility gap in AI-driven scientific research, with clear performance benchmarks.

arXiv:2611.02833v1 Announce Type: cross Abstract: AI scientists are expanding automated research across scientific domains, yet their ability to turn the scientific record into a foundation for autonomous discovery remains elusive. Here we uncover a fundamental barrier to this transition and demonstrate a route to overcome it in computational quantum science, where advances shape both what we can learn from complex quantum systems and what quantum computing can ultimately deliver. To identify this barrier, we introduce OmniQ, an expert-audited virtual research environment that converts published studies into executable reproduction tasks. Across 59 papers spanning classical simulation, quantum algorithms and quantum-property characterization, we systematically evaluate five agentic systems powered by large language models and six third-party agent harnesses. Our findings reveal that current AI scientists often fail to reproduce published results, exposing a fundamental mismatch between what scientific papers communicate and what autonomous agents require. By contrast, human expert intervention can turn these failures into successful reproductions, showing that the missing information can be identified and converted into reusable research experience. Guided by this observation, we develop Residual Agents (RA), a quantum-tailored self-improving AI scientist that distils externally verified workflow repairs into such experience. RA substantially improves research performance under fixed base models and limited adaptation budgets. For example, RA raises DeepSeek V4.1 Flash performance from 68% to 85%, matching Claude Code with Opus 5 at a third of its cost despite using a weaker base model. We integrate all reproduced results into an extensible platform built on the model context protocol, making verified research workflows directly accessible to AI scientists and allowing new scientific papers to be continuously incorporated.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!