Research Editor selected
Berkeley AI Research (BAIR) presents SPEX and ProxySPEX, algorithms that identify influential interactions among features, training data points, and model components at scales far beyond prior methods. SPEX exploits sparsity and low-degreeness to reframe interaction search as a sparse recovery problem; ProxySPEX adds hierarchy to achieve similar performance with roughly 10x fewer ablations. The methods are demonstrated on feature attribution (long-context sentiment, a modified trolley problem),
Why it matters: It offers a scalable, open-source interpretability framework with concrete demonstrations across feature, data, and component attribution, useful for researchers and practitioners working on model transparency.
interpretabilitylarge language modelsattribution methods