Live intelligence

Latest AI updates

2 updates
Research

ModHarness-RL treats agentic RL harnesses as learnable, evolving programs

ModHarness-RL reframes the harness around an agentic model — the scaffold controlling what the model sees of its interaction and what guidance it gets — as programs learned from data rather than hand-written and fixed. Interactions are recorded as structured State made of typed blocks, with a Compression program assembling history into context and a Steering program supplying guidance when behavior deviates. During RL training, candidate programs are proposed from recent trajectories, verified by execution, and replayed over past trajectories so the harness tracks shifts in model behavior. Experiments on CodeSearch, plus ALFWorld and BIRD SQL with models from 1.5B to 8B, show the Compression and Steering mechanisms improve held-out performance over a fixed-harness baseline in most settings.

agentic reinforcement learningagent scaffoldsCodeSearch
Research Editor selected

ECOS: Environment-Calibrated On-Policy Self-Distillation for Language Agents

The paper introduces ECOS, a method that uses environmental outcomes to calibrate how much a language agent trusts its own Teacher guidance during on-policy self-distillation. Command-level advantages scale Teacher preferences and determine which self-written reflections and skills are reinforced. Without skills at inference, 3B and 7B agents reach 90.5% and 93.3% macro success on seen ALFWorld tasks and 75.5% and 80.5% success on WebShop. On unseen ALFWorld tasks, they outperform GRPO under the same protocol by 11.0 and 7.6 percentage points, and an ablation shows supervising only executable commands raises 3B WebShop success from 52.3% to 75.0%.

Why it matters: It presents a concrete training method and comparative results for improving language agents with environment-calibrated self-distillation.

language agentsself-distillationALFWorld