Bridging Task Planning and Execution for Language-Conditioned Bimanual Manipulation
This paper presents a zero-shot vision-language framework for execution-aware bimanual manipulation that jointly reasons about task objectives and physical feasibility. Planning uses a structured scene representation combining semantic object relations with execution constraints, while compatible actions are organized into parallel bimanual stages with explicit pre- and post-conditions. A hierarchical validator evaluates conditions under perceptual uncertainty and uses stage-level execution history for local recovery or targeted replanning. Experiments on the CENTAURO humanoid across nine language-conditioned scenarios report higher task success than a non-execution-aware baseline and fewer model queries in failure scenarios than always replanning.
It offers a concrete research approach for integrating physical execution constraints and recovery into language-conditioned robot planning, with reported validation on a humanoid platform.
Comments & Questions (0)
No comments yet
Be the first to comment!