Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosis

About

Accurate medical diagnosis often involves progressive visual focusing and iterative reasoning, characteristics commonly observed in clinical workflows. While recent vision-language models demonstrate promising chain-of-thought (CoT) reasoning capabilities via reinforcement learning with verifiable rewards (RLVR), their purely on-policy learning paradigm tends to reinforce superficially coherent but clinically inaccurate reasoning paths. We propose MedEyes, a novel reinforcement learning framework that dynamically models clinician-style diagnostic reasoning by progressively attending to and interpreting relevant medical image regions. By incorporating off-policy expert guidance, MedEyes converts expert visual search trajectories into structured external behavioral signals, guiding the model toward clinically aligned visual reasoning. We design the Gaze-guided Reasoning Navigator (GRN) to emulate the diagnostic process through a dual-mode exploration strategy, scanning for systematic abnormality localization and drilling for detailed regional analysis. To balance expert imitation and autonomous discovery, we introduce the Confidence Value Sampler (CVS), which employs nucleus sampling and adaptive termination to create diverse yet credible exploration paths. Finally, the dual-stream GRPO optimization framework decouples on-policy and off-policy learning signals, mitigating reward assimilation and entropy collapse. Experiments demonstrate that MedEyes achieves an average performance improvement of +8.5\% across multiple medical VQA benchmarks, validating MedEyes's potential in building interpretable medical AI systems.

Chunzheng Zhu, Yangfang Lin, Shen Chen, Yijun Wang, Jianxin Lin• 2025

Related benchmarks

TaskDatasetResultRank
Medical Visual Question AnsweringSLAKE (test)--
29
Medical Visual Question AnsweringVQA-RAD (test)
Accuracy70.7
13
Medical Visual Question AnsweringPathVQA (test)
Accuracy64.8
13
Medical Visual Question AnsweringPMC-VQA (test)
Accuracy55.3
13
Medical Visual Question AnsweringMMMU Health & Medicine (test)
Accuracy59.7
12
Showing 5 of 5 rows

Other info

Follow for update