Back to AI News
arxiv

MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation

MIRA is a training framework that improves multimodal reasoning robustness by injecting deceptive visual contexts during training, creating 'hard traps' that stress-test models against misleading information. It also introduces a group-wise reflection-triggering mechanism for autonomous error detection and correction. Experiments show an average 7% improvement on in-domain benchmarks without human annotations.

AI Brief

This paper presents a concrete method with measurable gains, addressing a known limitation in multimodal RLVR, offering practical value for AI researchers and engineers.

arXiv:2611.03087v1 Announce Type: cross Abstract: While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, existing frameworks suffer from a critical "perception-reasoning gap." Due to an over-reliance on seemingly relevant visual tokens, even minor perceptual perturbations can propagate through the reasoning process, leading to compounding hallucinations. To address this issue, we propose MIRA, a training framework that improves robustness to erroneous visual contexts while enhancing logical reasoning ability. By injecting filtered, deceptive visual contexts during training, we construct challenging "hard traps" that stress-test the model's robustness to misleading information. Furthermore, we introduce a group-wise reflection-triggering mechanism that enables the model to autonomously detect and rectify inconsistencies between visual cues and logical constraints, which is ultimately internalized as an intrinsic policy behavior. Importantly, MIRA does not rely on human annotations. Experimental results across multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks, with consistent improvements on vision-centric benchmarks. These findings highlight that active error recovery is essential for robust multimodal reasoning. Comprehensive ablation studies and analyses further provide insights into why MIRA is effective.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!