Falsification-Gated Self-Evolution Lets LLM Agents Test Memory Updates Before Committing
The paper proposes Falsification-Gated Self-Evolution (FGSE), a verifier-grounded framework for deciding when lessons derived from an agent episode should become persistent memory. FGSE represents each candidate lesson as a structured hypothesis with a precondition, behavior change, expected effect, and verifier, then tests it in a temporary state using target-transfer, falsification, and archived-regression probes. It commits, refines, or rejects the hypothesis based on measured gain and risk. Reported results include 39.8 WebArena success rate, 78.8 AppWorld average completion, 0.724/0.487 Pass^1 on tau-Retail/tau-Airline, 5.0% falsification failures, 1.3% regression damage, and 3.6% harmful committed updates.
It offers a concrete, benchmarked method for making long-term memory updates in LLM agents safer and more reliable rather than writing episode lessons directly into persistent state.
Comments & Questions (0)
No comments yet
Be the first to comment!