Motion-Aware Reward Model Targets 'Motion Collapse' in Video Editing
Researchers identify a failure mode called motion collapse in reward models for instruction-guided video editing: on VE-Bench, a composite reward preferred a motion-suppressed candidate in 97% of cases, and learned video rewards and a VLM judge also struggled with mild suppression. They propose a motion-aware reward model that adds an RGB frame-difference stream and preference training against motion-suppressed and fabricated-motion negatives, with a distillation anchor to preserve alignment with human judgments. The model cut selection of motion-suppressed candidates to 0% on the motion ladder while reaching a Spearman correlation of 0.57 with human quality ratings, detected unseen suppression variants, and preserved motion during reward-guided fine-tuning on two editing pipelines.
It exposes a concrete blind spot in video-editing reward models and offers a tested architectural fix, which matters to teams using rewards for video generation or editing pipelines.
Comments & Questions (0)
No comments yet
Be the first to comment!