Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization

About

Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models produce excessively verbose responses even for simple queries, resulting in test-time inefficiency and even degraded accuracy. Prior work has attempted to mitigate this issue via adaptive reasoning strategies, but these methods largely overlook a fundamental bottleneck: visual perception failures. We argue that stable reasoning critically depends on low-level visual grounding, and that reasoning errors often originate from imperfect perception rather than insufficient deliberation. To address this limitation, we propose Gated Perception-Reasoning Optimization (GPRO), a meta-reasoning controller that dynamically routes computation among three decision paths at each generation step: a lightweight fast path, a slow perception path for re-examining visual inputs, and a slow reasoning path for internal self-reflection. To learn this distinction, we derive large-scale failure attribution supervision from approximately 790k samples, using teacher models to distinguish perceptual hallucinations from reasoning errors. We then train the controller with multi-objective reinforcement learning to optimize the trade-off between task accuracy and computational cost under uncertainty. Experiments on five benchmarks demonstrate that GPRO substantially improves both accuracy and efficiency, outperforming recent slow-thinking methods while generating significantly shorter responses.

Xingjian Diao, Zheyuan Liu, Chunhui Zhang, Weiyi Wu, Keyi Kong, Lin Shi, Kaize Ding, Soroush Vosoughi, Jiang Gui• 2026

Related benchmarks

TaskDatasetResultRank
Multimodal Mathematical ReasoningMathVerse (test)
Accuracy (ALL)48.7
33
Multi-modal ReasoningMMVet (test)
Accuracy70.9
30
Multimodal Mathematical ReasoningMathVista (test)
Accuracy74.2
17
Multimodal Mathematical ReasoningMathVision (test)
Accuracy31.2
17
Dynamic mathematical reasoningDynaMath (test)
Accuracy59.2
15
Showing 5 of 5 rows

Other info

Follow for update