Representational Atoms in Neural Networks
The paper formally defines fundamental representational units (FRUs) and introduces fidelity and stability as evaluation criteria. It proves that threshold-activated sparse autoencoders can identify FRUs with high fideli...