Research
Representational Atoms in Neural Networks
The paper formally defines fundamental representational units (FRUs) and introduces fidelity and stability as evaluation criteria. It proves that threshold-activated sparse autoencoders can identify FRUs with high fidelity and stability under appropriate conditions, and reports large-scale experiments supporting the result. Further analyses indicate that higher-stability FRUs are more monosemantic and can be composed across layers to recover semantic organization corresponding to human conceptual structure. The work offers a unified framework for defining, evaluating, and identifying representational units in neural networks.
neural network interpretabilitysparse autoencodersrepresentational units