Research
Study: Exposing Success Criteria to Embodied Agents May Cause Overfitting, Not Better Task Learning
A new arXiv paper investigates the practice of exposing benchmark success criteria to self-improving embodied agents, a method called Criteria Exposure (CE). Controlled experiments show that agents with CE achieve higher scores under the given criteria, but the advantage disappears when criteria are slightly altered without changing instructions. The skills developed under CE transfer poorly across tasks, suggesting overfitting to the verifier rather than learning the task. The authors propose instruction-faithful criteria to better reflect actual task performance.
embodied agentsbenchmark evaluationoverfitting