Share your thoughts, 1 month free Claude Pro on usSee more

Medical Visual Question Answering on MMMU Health & Medicine (test)

74.5Accuracy

OpenAI-o3

Updated 4d ago

Evaluation Results

Method	Links
OpenAI-o3 2026.04		74.5
GPT-4.1 2026.04		73.6
Gemini 2.5 Pro 2026.04		72.8
GPT-5 2026.04		70.7
InternVL3-8B 2026.04		62.3
Qwen2.5-VL-32B 2026.04		60.1
HuatuoGPT-Vision-34B 2026.04		60.1
MedEyes 2025.11		59.7
MMedAgent-RL-7B 2026.04		58.9
PixelReasoner-RL-v1-7B 2026.04		58
DeepEyes-7B 2026.04		57.8
Mini-o3-7B-v1 2026.04		57.4
VILA-M3-40B 2026.04		56.6
MedLVR 2026.04		56.6
MedAgent-Pro 2026.04		52.9
InternVL-2 2025.11		52.7
GMAI-VL 2025.11		51.2
GRIT† 2025.11		49.5
AURA 2026.04		49.3
DeepEyes† 2025.11		49.1
Med-Flamingo 2025.11		47.5
Qwen2.5-VL-7B 2026.04		46.4
MedVLM-R1 2026.04		45.9
Med-R1 2026.04		44.7
MMedAgent-7B 2026.04		44.1
MEDVISTAGYM 2026.04		42.9
LLaVA-Next-13B 2026.04		40.1
SMR-Agents 2026.04		40.1
LLaVA-Med-7B 2026.04		38.8
LLaVA-v1.5-8B 2026.04		38.2
LLaVA-Med 2025.11		36.9
MedVLM-R1 2025.11		35.5
Qwen2.5-VL-3B 2025.11		34.3
LLaVA-Next-7B 2026.04		33.1
Med-R1 2025.11		32.7
MedVInT 2025.11		28.3
Med-Flamingo 2026.04		28.3
RadFM 2025.11		27
RadFM 2026.04		27