AudioSphere: Self-Supervised Spatial Audio Representations for Frame-Level SELD
AudioSphere is a multi-channel masked autoencoder trained on Ambisonics recordings that reconstructs spectral content and directional cues using a joint spatiotemporal masking strategy over time-frequency patches and intensity vectors. The model supports frame-level predictions and produces clip-level representations through aggregation. The authors also release RealSELD, a standardized benchmark for evaluating frozen backbones on real-world multi-channel sound event detection and localization. They report that AudioSphere enables SELD with a frozen self-supervised backbone and matches or exceeds prior self-supervised audio embedding models on clip-level classification and frame-level sound event detection.
It introduces a spatial self-supervised audio backbone plus a real-world SELD benchmark, offering practical value for researchers working on multi-channel audio understanding.
Comments & Questions (0)
No comments yet
Be the first to comment!