I've made some interesting strides in AI interpretability: recasting trained neural nets into a geometry where you can read them exactly, with arithmetic — the exact counterpart of Anthropic's averaged "J-lens," including (I believe) the first measurement of how lossy averaged lenses actually are.
AIHUB
Legible Networks: recasting neural nets so you can read them exactly
A new interpretability method called Legible Networks recasts trained neural networks into a geometry that allows exact reading with arithmetic. The author claims this is the exact counterpart of Anthropic's averaged J-lens and includes the first measurement of how lossy averaged lenses actually are. This represents a concrete advance in AI interpretability by moving from averaged approximations to exact representations.
Offers a novel exact interpretability technique and the first empirical measurement of loss in averaged lenses, directly useful for AI safety and mechanistic interpretability researchers.
Comments & Questions (0)
No comments yet
Be the first to comment!