WeightBench: Benchmarking LLMs as Weight-Space Programmers
The paper introduces WeightBench, a benchmark for evaluating how well large language models can read, modify, and create neural-network weights without gradient descent. It covers 42 tasks across five tracks, including weight reading, fixing, writing, recognizing impossible edits, and data-free compression, on models ranging from 2K-parameter policies to 7B language models. Results show that frontier agents can handle some small-network tasks but still struggle to patch language models, compress them without data, or reliably identify impossible edits.