The Value of Thinking: Learning When to Reason in Hybrid Decision Models
The paper proposes a zero-or-T thinking paradigm in which a single model either answers from implicit computation in one forward pass without generating tokens or performs full autoregressive reasoning when the expected benefit justifies the token cost. It implements this as a hybrid decision model with a frozen backbone and a lightweight self-routing block that estimates the value of thinking against a per-request price. For settings without per-decision labels, such as episodic agentic tasks, the authors introduce Calibrated Decision Policy Optimisation to train the routing block from episode-level returns. Evaluations on MMLU-Pro, AGIEval, GPQA-Diamond, JevBench, BANKING77 and MiniWoB report accuracy and token-cost improvements, including a 72.5% median latency reduction on JevBench and an 80.1% token-cost cut on MiniWoB with HDM-27B.
Why it matters: It presents a concrete routing and reinforcement-learning method for reducing reasoning token costs while preserving accuracy across QA and agentic tasks.