Motion-Aware Reward Model Targets 'Motion Collapse' in Video Editing
Researchers identify a failure mode called motion collapse in reward models for instruction-guided video editing: on VE-Bench, a composite reward preferred a motion-suppressed candidate in 97% of cases, and learned video rewards and a VLM judge also struggled with mild suppression. They propose a motion-aware reward model that adds an RGB frame-difference stream and preference training against motion-suppressed and fabricated-motion negatives, with a distillation anchor to preserve alignment with human judgments. The model cut selection of motion-suppressed candidates to 0% on the motion ladder while reaching a Spearman correlation of 0.57 with human quality ratings, detected unseen suppression variants, and preserved motion during reward-guided fine-tuning on two editing pipelines.