BoD: Backpropagating Through Depth Improves Looped Language Model Code Generation
This paper introduces Backpropagation through Depth (BoD), a training method for looped language models that backpropagates through all intermediate depths rather than only the final depth. BoD improves code-generation s...