Research
AudioSphere: Self-Supervised Spatial Audio Representations for Frame-Level SELD
AudioSphere is a multi-channel masked autoencoder trained on Ambisonics recordings that reconstructs spectral content and directional cues using a joint spatiotemporal masking strategy over time-frequency patches and intensity vectors. The model supports frame-level predictions and produces clip-level representations through aggregation. The authors also release RealSELD, a standardized benchmark for evaluating frozen backbones on real-world multi-channel sound event detection and localization. They report that AudioSphere enables SELD with a frozen self-supervised backbone and matches or exceeds prior self-supervised audio embedding models on clip-level classification and frame-level sound event detection.
spatial audioself-supervised learningaudio representation