Back to AI News
arxiv

CAMP-II trains coding agents to use files as long-horizon memory

Researchers introduce CAMG-II, a suite of long-horizon agentic-RL environments spanning Shop, Coding, AutoResearch, General, and Visual tasks, each with Bash access and an episode-persistent workspace. They also present CAMP-II, which trains a single policy across all five environments using fully asynchronous on-policy distillation from a frozen teacher with prior file-operation experience. On CAMG-II, CAMP-II reports 2.97 times the gain of the strongest OPD baseline. The learned memory behavior also transfers to Terminal-Bench 2.1 and SWE-Bench Pro V2 with improved success rates.

AI Brief

It provides a concrete benchmark and training approach for file-based memory in long-horizon coding agents, with reported gains and transfer to external agent benchmarks.

arXiv:2611.14009v1 Announce Type: cross Abstract: Language-model agents increasingly tackle long-horizon tasks whose interaction histories exceed the model's active context. They must therefore decide what to write down and what to read back, and when to do either. Recent work has begun to use on-policy distillation (OPD) to make memory control part of the policy, relying on memory tools and compaction protocols that lie outside either model's pre-training. However, this weakens the distillation on both sides: the teacher cannot give useful guidance on an interface it has never used, and the student samples too few meaningful memory actions for that guidance to take effect. To study this problem, we introduce Coding Agent Memory Gym II (CAMG-II), a suite of long-horizon agentic-RL environments spanning Shop, Coding, AutoResearch, General, and Visual. Alongside each environment's native task interface, CAMG-II provides ordinary Bash access and an episode-persistent workspace, enabling the policy to create, revise, search, and reuse files as memory across context replacements. We also introduce Coding Agent Memory Post-Training II (CAMP-II), which trains a single policy jointly across all five environments with fully asynchronous OPD to learn this file-based memory behavior directly from a frozen teacher with a prior for file operations. On CAMG-II, CAMP-II obtains 2.97 times the gain of the strongest OPD baseline. The memory behavior CAMP-II learns generalizes to two external benchmarks, Terminal-Bench 2.1 and SWE-Bench Pro V2, with improved success rates.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!