UniOMA: Unified Optimal-Transport Multi-Modal Structural Alignment for Robot Perception
The paper proposes UniOMA, a multimodal alignment method that augments existing contrastive losses with a geometry-aware Gromov-Wasserstein (GW) distance-based regularization. It encodes intra-modal geometry for each modality and reduces cross-modal structural discrepancies through a dynamically learned GW barycenter, encouraging structural consistency beyond instance-level contrastive alignment. The approach is applied to robot perception tasks involving underexplored modalities such as force and tactile signals, where data often exhibit varying sample densities. Experiments across five robotic benchmarks reportedly improve structural alignment and downstream performance over state-of-the-art multimodal contrastive baselines, and the GW regularization is described as integrable into most InfoNCE-like objectives.