Live intelligence

Latest AI updates

1 updates
Research Editor selected

How Much Should an Agent Remember? Deployment Lessons from Self-Distilled Memory for LLM Agents

The paper describes a pipeline that mines short lessons from an LLM agent's own trajectories and consolidates them into guidelines that can be supplied at inference. It reports deployment experience from the open-source altk-evolve library, IBM's CUGA agent, and watsonx Orchestrate, evaluated on AppWorld across models with 40-92% baseline task completion. A central finding is that the optimal amount of memory depends on the model: DeepSeek-V3.2 gains 9.5 points of task completion with its full 191-guideline set, while gpt-oss-120b improves from 39.9% to 55.4% with a selected subset of about 29 guidelines versus 51.2% with all 199. The authors also document failure modes including a backfiring high-support guideline, lost provenance during consolidation, and a swallowed API error.

Why it matters: It offers concrete benchmark results and deployment lessons for teams building memory into LLM agents.

LLM agentsagent memoryself-distillation