On-Policy Training Helps Multi-Hop RAG Retrievers Recover From Mistakes
A new paper proposes training chain embedding retrievers on their own retrieval histories, including mistakes, rather than only on gold-standard histories. The method mixes these on-policy states with teacher-forced exam...