Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR

About

Reinforcement learning with verifiable rewards (RLVR) improves vision-language models (VLMs) by optimizing outcome rewards derived from final answers. However, such outcome-only rewards do not tell the model which image regions justify an answer. For questions that require visual grounding, these rewards cannot distinguish responses supported by relevant visual evidence from those produced by language-prior shortcuts or lucky guesses. We introduce EASE (Evidence-Anchored Spatial Attention), which augments multimodal RLVR with visual-evidence process supervision. EASE converts annotated evidence regions into a smoothed visual-token target and uses it to guide response-to-image attention during RL training, but only on high-reward trajectories. The annotations are used solely as privileged training labels, while inference requires only the original image and question. Across Qwen2.5-VL-7B, Qwen3-VL-4B, and Qwen3-VL-8B, EASE raises average scores over DAPO by 2.5 to 3.1 points on perception, hallucination, visual math, and multimodal reasoning benchmarks. Diagnostics and ablations show that EASE better aligns visual attention with annotated evidence regions.

Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningWeMath
Accuracy72.9
225
Mathematical ReasoningMathVista
Accuracy (%)75.2
29
Mathematical ReasoningMathVerse-V
Accuracy67.8
28
Multimodal ReasoningMMK12
Accuracy81.6
23
Logic reasoningLogicVista
LogicVista Accuracy49.6
16
Geometric ReasoningGeo3K
Accuracy48.9
13
Showing 6 of 6 rows

Other info

Follow for update