SPEX and ProxySPEX: Scalable Interaction Discovery for LLM Interpretability
Berkeley AI Research (BAIR) presents SPEX and ProxySPEX, algorithms that identify influential interactions among features, training data points, and model components at scales far beyond prior methods. SPEX exploits spar...