Self-Improvement with Auxiliary Rewards: Learning from Verified Traces and Evaluating Transfer
This paper investigates using auxiliary trajectory preferences, specifically confidence-based (SC) and entropy-based (UID-Conj.) metrics, to enhance small language model self-improvement and transfer under limited superv...