LoCo: Local Preference Learning for Reasoning Compression
LoCo is a new method that reduces the inference cost of large reasoning models by learning when to stop reasoning. It detects overthinking states, regenerates shorter verified continuations, and trains with DPO on state-...