Sage-Evolve-Preview: Adaptive Observation for Post-Training Self-Improvement
The paper introduces adaptive observation (AdaObs), a mechanism for post-training recursive self-improvement that keeps the anchor benchmark objective fixed while adapting the observation used to diagnose progress. When improvement plateaus, a controller refines diagnostic granularity, escalates difficulty, and adds related tasks; validated increments are fused into training while every checkpoint is still evaluated against the anchor. Across eight independently optimized anchors in long-context reading comprehension and instruction following, AdaObs raises the mean score from 66.4 to 73.7 under a matched data budget and outperforms the anchor-only FixedObs baseline. The evolved harness also improves the seven-task average on the independent PostTrainBench across two agent backends.
It proposes a concrete training-loop mechanism for escaping self-improvement plateaus and reports matched-budget gains across multiple benchmarks and backends.
Comments & Questions (0)
No comments yet
Be the first to comment!