Automated AI newsroom

AI News

High-signal AI developments, independently scored, summarized and organized for fast reading.

Live intelligence

Editor-selected AI developments

330 updates
Research Editor selected

OpenConjecture Tests Frontier Models on Randomly Sampled Math Conjectures

Researchers introduce OpenConjecture, a dataset of conjectures drawn from arXiv mathematics papers published since February 2026, and use a random sample of 200 as open problems. Frontier GPT models were run over three passes with a reproducible protocol and no problem-specific mathematical guidance. Models produced candidate solutions for roughly 60% of conjectures, with counterexamples about 1.3 times more common than proofs. The analysis finds some resolutions deviate from author intent, such as proposing the trivial group as a counterexample, and that many proofs follow closely from existing results, though some show at least moderate novelty.

Why it matters: It offers a reproducible, sampling-based benchmark that moves LLM math evaluation past cherry-picked breakthroughs toward fidelity, attribution and novelty of solutions.

LLM mathematical reasoningbenchmark and evaluation designOpenConjecture dataset
Research Editor selected

On-Policy Training Helps Multi-Hop RAG Retrievers Recover From Mistakes

A new paper proposes training chain embedding retrievers on their own retrieval histories, including mistakes, rather than only on gold-standard histories. The method mixes these on-policy states with teacher-forced examples and masks alternative correct passages to avoid penalizing valid continuations. The authors report more complete evidence retrieval and better recovery from errors, with transfer without additional training to harder long-chain variants of HotpotQA and 2WikiMultiHopQA constructed for the study.

Why it matters: The study addresses a concrete reliability problem in multi-hop RAG: retrieval errors that compound when subsequent searches depend on previously retrieved passages.

Retrieval-augmented generationEmbedding modelsOn-policy training
Research Editor selected

Simulation-based reinforcement learning improves AI psychiatric intake in role-played encounters

An arXiv preprint reports that multi-turn reinforcement learning in simulation improved a language model’s structured psychiatric intake performance compared with its identically prompted base model. In 120 encounters with psychiatrists role-playing standardized patients, independent psychiatrist evaluators preferred the trained agent in 76.7% of matched scenario pairs, with improvements in communication and differential diagnosis. In adversarial simulated presentations, under-triage of acute safety risks fell from 30.5% to 12.9%; the findings do not establish effectiveness with real patients, and residual gaps require safeguards and clinician oversight.

Why it matters: The study provides concrete evidence that simulation-based training can improve psychiatric conversational agents while highlighting safety limitations and the gap between role-played evaluation and real-world care.

Reinforcement learningPsychiatric intakeConversational AI
Research Editor selected

MetaRefine Improves Image Quality Assessment with Geometry-Aware Score Refinement

Researchers introduce MetaRefine, a lightweight architecture that refines existing image assessment scores using original-image geometry, multi-level visual features, and the frozen model's score. Across 100 configurations on 21 datasets, it improved PLCC in 88 configurations and SRCC in 85, while reducing MAE in 90 and RMSE in 89. The reported median parameter overhead was 1.11%.

Why it matters: The work offers a practical method for improving image quality assessment models while preserving existing scoring pipelines and adding limited parameter overhead.

MetaRefineimage quality assessmentcomputer vision
Research Editor selected

Algebraic World Model: From Exploration to Proofs

The paper introduces the Algebraic World Model (AWM), a framework that explores unfamiliar environments, forms executable Python hypotheses, and refines them into typed mathematical models. AWM uses category-theory-guided simplification and Lean 4 formalization to prove reachability and impossibility, including goals beyond explored trajectories. On two impossible game levels it produced kernel-checked proofs in all six runs, while reported baselines produced none; across 25 public ARC-AGI-3 games its models replayed all 183 winning trajectories and, with Claude Opus 5, cleared every level using 43% of the human baseline's actions.

Why it matters: It presents a concrete method for turning environment exploration into machine-checked mathematical proofs, with reported results on ARC-AGI-3 and formal impossibility claims.

Algebraic World ModelFormal verificationARC-AGI-3
Research Editor selected

MSafeTemp: Template-Based Multilingual Safety Alignment Across 60 Languages

Researchers propose a scalable template-based augmentation pipeline that extracts safe templates from harmful prompts, translates them, and fills slots with culturally authentic harmful and benign entities. The work releases MSafeTemp, a validated corpus spanning 60 languages for multilingual safety alignment and evaluation. Experiments show English-only evaluation can misjudge multilingual safety: attacks that fail in English may succeed when translated, and culturally localized variants expose additional failures. Template-based augmentation also improves safety performance beyond English.

Why it matters: It provides a concrete multilingual safety dataset and pipeline that exposes gaps in English-only safety evaluation and training.

LLM safetymultilingual NLPsafety alignment
Research Editor selected

BURGER benchmark tests VLA generalization through robotic drawing

Researchers introduced BURGER, a language-conditioned robotic drawing benchmark with a prompt-driven pipeline for generating continuous drawing trajectories in simulation and the real world. Using 28,200 simulated demonstrations across 282 drawing tasks, they evaluated five representative vision-language-action models on data scaling, language grounding, and multimodal behavior. The benchmark revealed distinct failure patterns and indicated that some VLA models benefit from greater task diversity and demonstration scale and can generalize to unseen compositions. A trained policy was also deployed on a Franka Panda arm to draw reactively under human intervention.

Why it matters: It provides a structured benchmark and empirical analysis for measuring how well vision-language-action models generalize across language-conditioned robotic tasks.

vision-language-action modelsrobotic generalizationbenchmarks
Research Editor selected

Rewindable Interactive Proofs Enable Efficient Scalable Oversight

The paper introduces rewindable interactive proofs (RIPs), a new relativizing interactive proof model for scalable oversight in which a weak verifier can rewind a powerful AI prover to an earlier interaction state and continue from there. The authors construct a RIP for computations whose outputs are robust to changing a small fraction of oracle answers, achieving an honest prover that runs in linear time and a verifier that runs in near-linear time after one-time preprocessing, without cryptography. They implement the protocol and report a preliminary MNIST experiment showing an RIP can be faster than a state-of-the-art deployed proof system. The work matters because rewinding is feasible whenever the verifier controls the prover's machine, such as trusted hardware or checkpointable virtual machines.

Why it matters: It offers a more efficient, cryptography-free scalable-oversight protocol with a working implementation, giving AI-safety researchers a practical verification tool for checking stronger models.

AI safetyscalable oversightinteractive proof systems
Research Editor selected

Ramanujan Challenge Analysis Introduces AI-Assisted Proof Evaluation Pipeline

An analysis of Ramanujan Challenge submissions compares the relative success of AI models, computer algebra systems, and formal tools on research-level number theory problems. It reports correct submissions conceptually distinct from official solutions and a proof of one published open conjecture. The authors introduce an AI-assisted pipeline for evaluating natural-language proofs, CAS code, and Lean formalizations. Compared with one-shot LLM judgment, it reduces false-positive verdicts on natural-language proofs from 23% to 6% and improves judgment accuracy on supporting code from 46% to 58%.

Why it matters: It offers a concrete methodology and measured results for reliably evaluating research-level mathematical proofs across multiple formats.

Ramanujan ChallengeAI for mathematicsproof evaluation
Research Editor selected

ClinGeX: A Skill-Centred LLM Agent for Clinical Genomic Analysis

Researchers developed ClinGeX, a large-language-model agent that composes 105 curated executable skills through task-specific retrieval and dependency-aware orchestration for clinical genomic analysis. On 223 temporally held-out benchmark cases, ClinGeX reached 71.7% macro-averaged task-level concordance with expert reference classifications, compared with 45.7% for the strongest comparator. In a human-AI collaboration study with 45 clinical genomic professionals assessing 135 cases, ClinGeX assistance increased raw case-level concordance across variant analysis, rare disease interpretation and molecular oncology decision-making, and reduced reported interpretation time. An exploratory one-month real-world assessment with 11 professionals reported frequent conclusion adoption and time savings across 96 self-selected analysis episodes.

Why it matters: It presents a concrete LLM-agent architecture with benchmark and human-study evidence for augmenting specialist clinical genomic interpretation.

ClinGeXclinical genomic analysisLLM agents
Research Editor selected

Collaborating LLM Agents Run Autonomous Quantum Spin Experiments and Reject Their Own Results

Researchers present an autonomous research laboratory in which LLM-based agents review each other's work and can halt or redirect investigations, including generating and rejecting research questions and demanding independent theoretical checks. The system was tested on ensembles of quantum spins in diamond, where agents derived the minimum number of calibration settings needed to predict responses to a defined family of microwave pulse sequences and verified the result computationally. When repeated reference measurements revealed signal drift, the agents classified the initial result as inconclusive and revised the measurement protocol without loosening acceptance criteria; the revised experiment met the criteria and supported the theoretical predictions. The work argues that peer-critiquing agent collectives can select questions, derive theory and test predictions experimentally.

Why it matters: It offers a concrete demonstration that multi-agent adversarial self-review can catch flawed experimental evidence in a physical-science setting, a key question for anyone building autonomous research systems.

autonomous research agentsNV-center quantum spinsAI for science
Research Editor selected

WxCrop agent turns extreme-weather forecasts into crop-loss estimates

Researchers present WxCrop, an agent that examines physically interpretable weather indices through causal analysis to assess agricultural hazards and predict crop loss for past and forecast dates. It was demonstrated in Florida for hurricanes, freezes and dry heat, with loss models calibrated on insurance records for each hazard. Reported checks include a hurricane index AUC of 0.98, held-out losses reproduced within 2%, and county rankings confirmed by independent production records with a rank correlation of 0.63. Users can request each crop group's loss as a fraction of expected season value, with every number sourced.

Why it matters: It demonstrates agentic AI converting weather forecasts into sourced, crop-specific loss estimates that could support faster agricultural disaster response and risk assessment.

WxCropagricultural riskextreme weather
Research Editor selected

Anthropic study: Experts adopt AI agent's random opinions and think they're their own

Anthropic conducted a study with 50 experts who used an AI agent with preferences determined by a coin toss. The experts followed the agent's view up to 86 percent of the time on judgment calls, and most believed the conclusions were their own. This highlights a significant risk of AI influence on human decision-making.

Why it matters: This study provides concrete, recent evidence of AI's persuasive power over expert judgment, with direct implications for AI safety and human oversight.

AI influencehuman oversightAnthropic research
Research Editor selected

Infini-AI-Lab Releases Hermit, an Open-Source Harness Adapter Framework for AI Agents

Infini-AI-Lab has released Hermit v0.1.0, an Apache-2.0 Python framework that trains an external "harness adapter" while the underlying agent model and harness remain frozen, so Codex or Claude Code agents can be adapted to new tasks without fine-tuning or forking. Hermit uses an RL-style loop with a Trainer, a judge and an Evolver, ships five evolution methods (GEPA, SkillOpt, MWM, Harness², Continual Harness) and versions every adapter in a git tree. Self-reported results with GLM 5.3 Flash include MWM reaching 0.795 on CL-Bench database exploration versus a 0.580 in-context baseline, and Harness² improving OfficeQA to 0.651 from 0.541 with no adapter. Adapters can be deployed to Codex, Claude Code or Pi, or exported as native plugins.

Why it matters: It gives agent developers a concrete, installable open-source way to train and deploy portable adapter layers for existing coding agents, with benchmark numbers and clear caveats.

Infini-AI-Labagent optimizationharness adapters
Research Editor selected

Beyond the Readout: A Latent Numerical Frame Shared Across Modality and Operation

This arXiv study uses causal interventions to test whether Gemma4-12B-it uses a shared internal numerical representation for text and image inputs and for addition and subtraction. It learns subspaces in the residual stream where swapping coordinates changes the model's answer, finding that reusing a text-derived subspace on images recovers only 53.2% of its causal effect, while a rotation and rescaling raises recovery to 91.4%. The analysis separates directions read by the output layer from hidden directions that still carry the number, and shows that swapping numbers in the hidden directions redirects the next digit in 77.6% of cases when the first digit is shared. The authors conclude that the model forms an abstract numerical concept upstream and unfolds it across time through relational geometry in different coordinate frames.

Why it matters: It offers mechanistic evidence about how a multimodal model represents numbers internally, distinguishing shared latent geometry from output-digit preparation.

mechanistic interpretabilitymultimodal modelsnumerical cognition
Research Editor selected

M4Bench Evaluates AI Coding Agents on Clinical EHR Derivations

Researchers introduced M4Bench, a benchmark of 28 clinical derivation tasks across 15 task families using MIMIC-IV and eICU, to test whether AI coding agents can reproduce EHR-derived variables and how clinician-reviewed agent skills affect results. In a Docker-isolated Codex campaign, skills raised reward by 0.136 over the no-skill baseline, with 26 of 28 tasks improving. Specification completeness accounted for most of the gain: an operational spec alone raised reward by 0.162 on an eight-task subset, while skills added only 0.024. The authors note the gains reflect partial agreement with reference derivations rather than completed tasks, and release tasks, skills, evaluation code, and sanitized per-run evidence as an open-source benchmark.

Why it matters: It provides a concrete benchmark and evidence on where coding agents help or fail in clinical EHR derivation, showing that precise specifications matter more than generic agent skills.

M4Benchclinical EHR derivationAI coding agents
Research Editor selected

TeamGym benchmarks LLM agents on team decisions with distributed information

Researchers introduced TeamGym, an environment for evaluating and training language-model agents on team decision-making tasks built from legal, finance, medical, and software engineering corpora. TeamGym uses a method to identify "pivotal information"—a minimal set of facts that is individually necessary and collectively sufficient for a correct decision—so it can control how information is distributed and measure whether agents integrate it. Across 8 language models and 12 source corpora, distributing pivotal information lowered success by 22.9 percentage points versus giving it to a single model, and requiring agents to extract that information themselves lowered success by a further 19.9 points. Reinforcement learning on final-decision loss improved decision quality and produced emergent coordination in participation, speaker selection, and communication.

Why it matters: It provides a concrete benchmark and training method for a key multi-agent weakness: sharing and integrating distributed information.

TeamGymmulti-agent systemsLLM evaluation
Research Editor selected

Timestral open time series models claim top spots on forecasting benchmarks

Timestral is a family of four probabilistic time series foundation models with 5M, 28M, 123M, and 209M parameters. The design uses Decoupled Horizon Forecasting to separate prediction tokens from causally encoded context, a covariate framework for known-future covariates, and a two-stage pipeline that pretrains only on large-scale synthetic data before post-training on mixed real and synthetic data with longer context. The report says Timestral-209M and Timestral-123M rank first and second on every metric of GIFT-Eval, TIME, and fev-bench. Weights for all four models are on Hugging Face, with inference code on GitHub.

Why it matters: Open model weights plus a claimed new state of the art on major time series benchmarks give researchers and practitioners a concrete forecasting advance to evaluate.

Timestraltime series forecastingfoundation models