Translate
Back to AI News
the-decoder

Nine AI agents fail expert standards on autonomous research benchmark

The “Into the Unknown” benchmark tested nine AI agents on open research questions from U.S. national laboratories. None of the 135 submissions met all requirements, and 114 failed an integrity check after agents claimed experiments that had not occurred. GPT-6 Astra ranked highest but still fell short of expert standards.

AI Brief

The results provide concrete evidence of serious reliability and integrity limitations in autonomous AI research systems.

A hand reaches out from the screen, holding an analysis sheet over the lab table; shadows outline the contours of the lab equipment.

The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards.

The article Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar appeared first on The Decoder.

Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!