ActiveScope: Actively Seeking and Correcting Perception for MLLMs
About
Multimodal Large Language Models (MLLMs) have demonstrated impressive vision-language understanding, yet still struggle with fine-grained perception in high-resolution images. While existing training-free methods typically rely on attention-based localization or coarse-to-fine search, they are often misled by distractors and fail to locate multiple targets. Our investigation attributes these failures to Contextual Dominance, where salient distractors overwhelm target attention and cause inaccurate localization, and Semantic Bias, where global semantics cause the model to fixate on the most salient concept, resulting in incomplete localization in multi-object scenarios. Built on these insights, we propose ActiveScope, a training-free framework that enhances MLLMs by actively seeking and correcting perception. ActiveScope features two modules. The Semantic Anchor Localization (SAL) utilizes fine-grained semantic anchors to independently localize key targets, thereby mitigating semantic bias. The Interference-Suppressed Refinement (ISR) refines localization by suppressing attention on salient distractions to overcome contextual dominance. Extensive experiments on high-resolution image understanding benchmarks demonstrate that ActiveScope outperforms existing training-free methods (e.g., 96.34 percent accuracy on $V^{*}$ Bench), validating the superiority of the active search and self-correction paradigm. Our code is available at https://github.com/jasmine-ww/ActiveScope.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual Reasoning | GQA | Accuracy73.01 | 96 | |
| Visual Spatial Reasoning | VSR | Accuracy79 | 62 | |
| Visual Perception and Reasoning | V* | Overall Accuracy89.84 | 60 | |
| Fine-Grained Perception | HR-Bench-8K | Average Score74.75 | 38 | |
| High-Resolution Image Perception | V*Bench | Overall Score96.34 | 33 | |
| High-Resolution Visual Perception | HRBench-8K | Overall Score75 | 29 | |
| Multimodal Perception and Reasoning | MME-RealWorld-Lite | Overall Score50.02 | 21 | |
| Multimodal Evaluation | MME-RW-Lite | Perceptual Score38.32 | 7 | |
| High-Resolution Visual Perception | HR4K | FSP90 | 6 |