DexDICE reconciles safety and performance in offline imitation learning
DexDICE introduces dual-expert offline imitation learning, using safety-compliant but potentially suboptimal demonstrations alongside high-return demonstrations that may violate safety guidelines. The method combines DICE-style offline learning with safe support constraints rather than conventional distribution constraints. The authors prove that the ideal constrained solution has zero unsafe-region visitation with high probability. They evaluate DexDICE on a re-curated DSRL benchmark and a real-world mobile-robot navigation task trained from human teleoperation, reporting improved performance and robustness to data scarcity and quality degradation.
It offers a concrete offline imitation learning method for balancing safety and performance when only separate safe and high-performing demonstrations are available.
Comments & Questions (0)
No comments yet
Be the first to comment!