Live intelligence

Latest AI updates

2 updates

Research Editor selected

GraphRail: Structured Claim Verification for Multi-Hop QA Reasoning

GraphRail is a new verification framework that represents requirements, evidence, and reasoning as structured claims and compares them without using a generative judge or gold answers. Across three multi-hop QA benchmarks and three reasoning frameworks, it improves error recall over generative verifiers while remaining stable under stochastic extraction. Its diagnoses can also guide online reasoning, providing a traceable way to detect and correct intermediate errors.

Why it matters: This is a concrete research contribution with benchmarked results and a novel verification approach, offering practical value for improving reasoning reliability in AI systems.

arxiv1d agoScore 82

AI verificationmulti-hop question answeringreasoning frameworks

Research Editor selected

MedPhysBench: Benchmarking LLMs on Medical Physics Calculations and Error Detection

MedPhysBench is a new benchmark with 1,200 held-out items testing language models on medical physics calculations and error detection across radiation therapy, imaging, nuclear medicine, and radiation protection. Twelve models scored 33.3–100% on calculations, with top models near-perfect but still making errors, and several models failing to catch planted errors like an omitted inverse-square correction. The benchmark includes code, per-item outcomes, and targeted test responses.

Why it matters: Provides a concrete, recent evaluation of LLM performance in a high-stakes medical domain, revealing both strengths and critical failure modes.

arxiv2d agoScore 85

MedPhysBenchlanguage modelsmedical physics