Live intelligence

Latest AI updates

2 updates
Research Editor selected

LLM Repairs Robot Policy by Editing Token-Embedding Weights

The paper applies weight-space programming to a robot foundation policy: a language model reads the policy's weights and edits token-embedding rows using a CPU workspace and budgeted simulator feedback, with no gradient updates or new demonstrations. Across three independent sessions on π0.5, success on 765 held-out paraphrases improved, with the best run rising from 86.3% to 92.0% (48 repairs, four regressions, exact paired p=1.31e-10). Gains concentrate on the 335 instructions containing edited tokens (74.3% to 87.5%), while matched random-direction edits do not help. The authors characterize the result as precise lexical repair rather than general acquisition of missing robot capabilities, and separately report that benchmark metadata lowered FastWAM success from 70.0% to 48.6%.

Why it matters: It offers a concrete, unusually detailed demonstration that an LLM can fix a robot policy's instruction grounding by editing a handful of embedding rows, plus a cautionary evaluation finding about benchmark metadata effects.

roboticsmodel editingLLM agents
Research

Weight-Space Programming Shows Localized Gains but Uneven Generalization

A systematic study evaluates Weight-Space Programming across 16 editing trajectories, seven benchmarks, and two Qwen3.5 model scales. It reports accuracy gains of up to 29.45 points on MATH-500, 4.42 on GPQA Diamond, 36.72 on IFEval, and 17.11 on SciBench, with a 29.45-point MATH-500 improvement from modifying only 1,023 parameters. Cross-task transfer was promising but uneven: a Math-edited checkpoint improved GPQA Diamond, IFEval, and SciBench, while SciCode performance was unchanged. Editing reliability remained inconsistent, and six of 16 trajectories retained the original weights when candidate improvements could not be validated.

Weight-Space ProgrammingModel editingCross-task generalization