Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification

About

Multimodal Large Language Models (MLLMs) achieve strong multimodal reasoning performance, yet we identify a recurring failure mode in long-form generation: as outputs grow longer, models progressively drift away from image evidence and fall back on textual priors, resulting in ungrounded reasoning and hallucinations. Interestingly, Based on attention analysis, we find that MLLMs have a latent capability for late-stage visual verification that is present but not consistently activated. Motivated by this observation, we propose Visual Re-Examination (VRE), a self-evolving training framework that enables MLLMs to autonomously perform visual introspection during reasoning without additional visual inputs. Rather than distilling visual capabilities from a stronger teacher, VRE promotes iterative self-improvement by leveraging the model itself to generate reflection traces, making visual information actionable through information gain. Extensive experiments across diverse multimodal benchmarks demonstrate that VRE consistently improves reasoning accuracy and perceptual reliability, while substantially reducing hallucinations, especially in long-chain settings. Code is available at https://github.com/Xiaobu-USTC/VRE.

Shuai Lv, Chang Liu, Feng Tang, Yujie Yuan, Aojun Zhou, Kui Zhang, Xi Yang, Yangqiu Song• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningMathVista
Accuracy71.2
257
Mathematical ReasoningWeMath
Accuracy68.7
161
Mathematical ReasoningMathVision
Accuracy26.5
144
Mathematical ReasoningMathVerse
Accuracy53.1
109
Logical reasoningLogicVista
Accuracy48.7
84
Multi-discipline ReasoningMMMU
Accuracy52.1
34
High-resolution perceptionV*-Bench v1.0 (test)
Overall Score83.8
10
Document UnderstandingChartQA v1.0 (test)
Overall Accuracy88.8
8
Real-world QARealworldQA v1.0 (test)
Score69.8
7
Document UnderstandingOCRBench v2.0 (test)
Accuracy (en)62.6
4
Showing 10 of 10 rows

Other info

Follow for update