BRIDGE: Balancing Representations by Generating Under-represented Data for Long-tailed Self-Supervised Learning
BRIDGE is a label-free feedback loop that improves self-supervised learning on long-tailed data by identifying under-represented images via kNN distance and generating local variants with a frozen diffusion model. It outperforms baselines across five long-tailed regimes on linear-probe and kNN tasks, and extends gains to ViT-S, low-label fine-tuning, and segmentation. The method requires no labels and leaves the pretraining objective unchanged.
Why it matters: This paper presents a concrete, novel method with strong empirical results for a common real-world problem (long-tailed data) in self-supervised learning, offering practical value for researchers and practitioners.