arXiv:2610.41482v1 Announce Type: cross
Abstract: Recursive textual memory can carry earlier errors into later updates, yet task performance alone does not establish memory reliability. We define self-consistency bias as the persistence of incorrect claims already present in the incoming memory. We present KEEPER, a comparative analysis of four auxiliary objectives along information-content and update-sensitivity axes within a shared recursive interface, examining how supervision targets relate to agent performance. Among evaluated conditions, reward-related prediction achieve the highest task performance before and after offline reinforcement learning, outperforming joint supervision. A claim-level analysis of one baseline trajectory documents error persistence despite corrective observations. Together, these analyses motivate evaluating error persistence and valid-information retention alongside task outcomes.
arxiv
KEEPER: Learning Control-Sufficient Textual Memory for Long-Horizon LLM Agents
The paper introduces KEEPER, a framework that analyzes auxiliary objectives for recursive textual memory in LLM agents, identifying self-consistency bias where incorrect claims persist in memory. It compares four supervision targets and finds reward-related prediction achieves the highest task performance before and after offline reinforcement learning. A claim-level analysis reveals error persistence despite corrective observations, motivating evaluation of error persistence and valid-information retention alongside task outcomes.
Provides a concrete, recent research contribution addressing a critical failure mode in long-horizon LLM agent memory, with practical implications for agent reliability.
Comments & Questions (0)
No comments yet
Be the first to comment!