Share your thoughts, 1 month free Claude Pro on usSee more

Medical Visual Question Answering on MMMU

70Accuracy

MedVLThinker-32B RL

Updated 1mo ago

Evaluation Results

Method	Links
MedVLThinker-32B RL 2025.08		70
GPT-4o 2025.08		68.82
Qwen2.5-VL-32B-Instruct 2025.08		63.92
GPT-4o-mini 2025.08		63.53
Gemme 3 27B 2025.08		60.78
MedTutor-R1 2025.12		58.82
HuatuoGPT-Vision-34B 2025.08		57.06
MedVLThinker-7B RL 2025.08		56.86
MedTutor-R1 w/ LLaVA-based 2025.12		56.38
MedTutor-R1 w/o RL 2025.12		54.73
Qwen2.5-VL-7B-Instruct 2025.08		52.94
Qwen2.5VL 2025.12		52.61
MedVLThinker-3B RL 2025.08		52.16
HuatuoGPT-Vision-7B 2025.08		50.59
Gemme 3 4B 2025.08		46.67
Qwen2.5-VL-3B-Instruct 2025.08		44.12
MedGemma 27B 2025.08		35.88
MedGemma 4B 2025.08		32.55
Llava Med v1.5 Mistral 7B 2025.08		31.37