When Agent Skills Go Stale: Runtime Behavior and Selective Maintenance in Evolving Environments
This arXiv paper studies how reused agent skill state degrades when environments change. Across four task settings and two models, previously beneficial skills reduced task performance by over 10 percentage points or increased execution cost by nearly 40% versus no skill. The authors introduce selective maintenance, which replays checks from successful executions without additional model calls, repairs affected skill state, and rebuilds when local repair is insufficient. They report accuracy improvements up to 67 percentage points and execution-step reductions up to 37% relative to reusing stale state.
It quantifies a practical failure mode in reusable agent skills and proposes a maintenance method that preserves inference-time savings as environments evolve.
Comments & Questions (0)
No comments yet
Be the first to comment!