Proximal Targets: Training Looped Refiners on Problems with Many Correct Answers
Researchers identify a loss floor in looped refiners such as HRM and TRM when deep supervision trains every pass toward a single stored answer for puzzles with multiple valid solutions, and show the loss-minimising pass...