Live intelligence

Latest AI updates

1 updates
Research

Representational Atoms in Neural Networks

The paper formally defines fundamental representational units (FRUs) and introduces fidelity and stability as evaluation criteria. It proves that threshold-activated sparse autoencoders can identify FRUs with high fidelity and stability under appropriate conditions, and reports large-scale experiments supporting the result. Further analyses indicate that higher-stability FRUs are more monosemantic and can be composed across layers to recover semantic organization corresponding to human conceptual structure. The work offers a unified framework for defining, evaluating, and identifying representational units in neural networks.

neural network interpretabilitysparse autoencodersrepresentational units