Live intelligence

Latest AI updates

2 updates
Research

A Full-Ledger Counterfactual Audit of Adaptive Reasoning

The paper introduces the Full-Ledger Counterfactual Value Audit (FLCVA), a method for comparing an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure while accounting for all signal costs. On GSM8K and MATH-500, a random 256-token continuation recovered wrong answers in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging correct answers in 1.4% and 1.9%. Correctness labels from independently sampled continuations predicted a separate continuation's outcome in both primary models, and offline replay improved performance on DeepSeek but was inconclusive for Qwen3. Under full cost accounting, the tested lightweight myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut.

Adaptive reasoningLLM compute allocationCounterfactual evaluation
Research Editor selected

The Value of Thinking: Learning When to Reason in Hybrid Decision Models

The paper proposes a zero-or-T thinking paradigm in which a single model either answers from implicit computation in one forward pass without generating tokens or performs full autoregressive reasoning when the expected benefit justifies the token cost. It implements this as a hybrid decision model with a frozen backbone and a lightweight self-routing block that estimates the value of thinking against a per-request price. For settings without per-decision labels, such as episodic agentic tasks, the authors introduce Calibrated Decision Policy Optimisation to train the routing block from episode-level returns. Evaluations on MMLU-Pro, AGIEval, GPQA-Diamond, JevBench, BANKING77 and MiniWoB report accuracy and token-cost improvements, including a 72.5% median latency reduction on JevBench and an 80.1% token-cost cut on MiniWoB with HDM-27B.

Why it matters: It presents a concrete routing and reinforcement-learning method for reducing reasoning token costs while preserving accuracy across QA and agentic tasks.

adaptive reasoningLLM inference efficiencyreinforcement learning