Live intelligence

Latest AI updates

1 updates
Research

STEMBench scores LLMs on postdoc-level physics, astrophysics and neuroscience problems

Researchers introduced STEMBench, a benchmark of twelve research problems in high-energy physics, astrophysics and neuroscience that are graded by each field's own figure of merit rather than by answer keys or unit tests. Each problem ships with two measured anchors — a no-domain-knowledge submission and an expert reference reproducing a published method — both produced by running the benchmark's released code. Across eight frontier models, task-level wins and domain-level leadership diverged: one model won five of twelve tasks yet led no domain mean. In a high-effort comparison, at least one model's mean score exceeded the expert anchor on seven of twelve tasks, while the other five involved uncertainty estimation, latent and causal inference, and cross-site clinical classification.

STEMBenchLLM benchmarksscientific reasoning