Research
Be My Eye: Learning to See Beyond a Robot's Own Perspective
The paper proposes a task-oriented active context sharing framework for multi-robot collaboration under partial observability, arguing that robots should selectively encode task-relevant information rather than passively transmit raw observations or generic visual features. Onboard observations and task instructions are jointly compressed into compact context representations guided by task-oriented future prediction and soft task-progress correspondence learning, then integrated into a pretrained Vision-Language-Action policy for bidirectional context exchange. Controlled experiments report substantial performance gains under constrained communication budgets, and three real-world dual-robot experiments validate the framework.
multi-robot collaborationvision-language-action modelsrobot perception