Research
Weight-Space Programming Shows Localized Gains but Uneven Generalization
A systematic study evaluates Weight-Space Programming across 16 editing trajectories, seven benchmarks, and two Qwen3.5 model scales. It reports accuracy gains of up to 29.45 points on MATH-500, 4.42 on GPQA Diamond, 36.72 on IFEval, and 17.11 on SciBench, with a 29.45-point MATH-500 improvement from modifying only 1,023 parameters. Cross-task transfer was promising but uneven: a Math-edited checkpoint improved GPQA Diamond, IFEval, and SciBench, while SciCode performance was unchanged. Editing reliability remained inconsistent, and six of 16 trajectories retained the original weights when candidate improvements could not be validated.
Weight-Space ProgrammingModel editingCross-task generalization