Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Perceptual Flow Network for Visually Grounded Reasoning

About

Despite the success of Large-Vision Language Models (LVLMs), general optimization objectives (e.g., standard MLE) fail to constrain visual trajectories, leading to language bias and hallucination. To mitigate this, current methods introduce geometric priors from visual experts as additional supervision. However, we observe that such supervision is typically suboptimal: it is biased toward geometric precision and offers limited reasoning utility. To bridge this gap, we propose Perceptual Flow Network (PFlowNet), which eschews rigid alignment with the expert priors and achieves interpretable yet more effective visual reasoning. Specifically, PFlowNet decouples perception from reasoning to establish a self-conditioned generation process. Based on this, it integrates multi-dimensional rewards with vicinal geometric shaping via variational reinforcement learning, thereby facilitating reasoning-oriented perceptual behaviors while preserving visual reliability. PFlowNet delivers a provable performance guarantee and competitive empirical results, particularly setting new SOTA records on V* Bench (90.6%) and MME-RealWorld-lite (67.0%).

Yangfu Li, Yuning Gong, Hongjian Zhan, Teng Li, Yuanhuiyi Lyu, Tianyi Chen, Qi Liu, Ziyuan Huang, Zhihang Zhong, Dandan Zheng, Yue Lu• 2026

Related benchmarks

TaskDatasetResultRank
GUI GroundingScreenSpot v2--
371
GUI GroundingScreenSpot Pro--
195
Visual Grounded ReasoningTreeBench--
153
Visual SearchV* Benchmark
Overall Success Rate90.6
54
PerceptionMME-RealWorld-Lite
Overall Score67
46
ReasoningMME-RealWorld-Lite
OCR Score83
37
PerceptionTreeBench
Overall Accuracy55.3
17
High-Resolution Visual Question AnsweringHR-Bench-8K
Overall Accuracy76.9
16
High-Resolution Visual Question AnsweringHR-Bench-4K
Overall Accuracy80.4
16
Showing 9 of 9 rows

Other info

Follow for update