Research Editor selected
FrontierPhysics: A New Benchmark for End-to-End AI Physics Research
FrontierPhysics is a benchmark created by 42 physicists with 56 tasks spanning theoretical, computational, and experimental physics. It evaluates AI agents on the full research pipeline—literature review, planning, experimentation, and manuscript writing—using both deterministic verifiers and expert rubrics. Across 22 models in 26 configurations, no agent passed more than 46 of 168 rollouts, with the main weaknesses being insufficiently rigorous reasoning and limited expert intuition rather than knowledge gaps.
Why it matters: Provides a rigorous, expert-curated evaluation of frontier AI agents' ability to conduct end-to-end physics research, highlighting critical reasoning deficiencies.
AI agentsphysics researchbenchmark evaluation