Research
Training LLMs to Follow Reasoning Instructions with Minimal Edits
Researchers propose edit-based training, a framework that learns from a model's own trajectories through localized textual corrections rather than full-trajectory imitation or trajectory-level reinforcement learning. An editor identifies the first point of failure under a specified criterion and proposes a minimal replacement span, so supervision is concentrated only on edited spans; the method can be applied offline or online. On the ReasonIF benchmark with Qwen3-32B, the approach reportedly improved reasoning-instruction compliance while largely preserving performance on untargeted tasks compared with baselines.
LLM reasoninginstruction followingsupervised fine-tuning