SOTA Medical Visual Question Answering on SLAKE and PapersWithCode

89.2Accuracy

Lingshu-32B

Updated 3d ago

Evaluation Results

Method	Links
Lingshu-32B 2026.01		89.2
PulseMind-72B 2026.01		85.6
Gemini-2.5-pro 2026.01		85
IBISAgent 2026.01		83.5
MedGemma 4B 2025.08		83.49
MedGemma 4B 2025.10		83.49
Phi3.5V-Med 2025.12		83.07
LINGSHU-7B + MED-SCOUT 2026.01		83
LINGSHU-7B 2026.01		82.8
Phi3.5V-Med 2025.12		82.28
Phi3.5V-Med 2025.12		82.28
Phi3.5V-Med 2025.12		81.89
PulseMind-32B 2026.01		81.5
MEDVISTA-R1 2026.01		81.36
MEDVISTA-R1 2026.01		81.36
Phi3.5V-Med 2025.12		81.1
HuatuoGPT-Vision-34B 2025.08		78.85
Qwen2.5VL-72B 2026.01		78.3
Lingshu 2026.01		78
MEDGEMMA-4B-IT 2026.01		77.9
Lingshu-7B 2026.01		77.8
InternVL3-78B 2026.01		77.4
Chiron-01-8B 2026.01		77.4
MedGemma 27B 2025.08		77.4
MedGemma 27B 2025.10		77.4
Chiron 2026.01		77.3
Claude-4.5-haiku 2026.01		77
GPT-4o 2025.08		76.44
GPT-o4-mini 2026.01		76.27
GEMINI-3-FLASH 2026.01		76.1
Gemini2.5-pro 2026.01		75.8
QWEN3-VL-4B-INSTRUCT + MED-SCOUT 2026.01		75.6
GPT-4o-mini 2025.08		75.24
Claude-4.5-sonnet 2026.01		75
HuatuoGPT-Vision-7B 2025.08		75
HuatuoGPT-Vision-7B 2025.10		75
MedVLSynther-3B 2025.10		74.76
MedVLThinker-32B RL 2025.08		73.96
GPT-5 2026.01		73.9
Robust-MMR 2026.02		73.9
QWEN3-VL-4B-INSTRUCT 2026.01		73.4
Qwen2.5-VL-32B-Instruct 2025.08		73.24
INTERNVL3-8B 2026.01		72.9
InternVL3-38B 2026.01		72.7
Gemme 3 27B 2025.08		72.6
MedVLSynther-7B 2025.10		72.36
QWEN3-VL-8B-INSTRUCT + MED-SCOUT 2026.01		72
Gemini-2.5-flash 2026.01		72
VILA-M3-40B 2026.01		71.4
Qwen2.5VL-32B 2026.01		71.2
HUATUOGPT-VISION-7B + MED-SCOUT 2026.01		71
GPT-4o 2026.01		70.9
GPT-5 2026.01		70.28
Qwen2.5vl-32B 2026.01		70.1
o1 2026.01		69.9
QWEN3-VL-8B-INSTRUCT 2026.01		69.6
HuatuoGPT-vision-34B 2026.01		69.5
HuatuoGPT-Vision-34B 2026.01		69.5
MedAgent-Pro 2026.01		69.4
MMedAgent-7B 2026.01		68.7
CPRD 2026.02		68.5
AURA 2026.01		68.4
HuatuoGPT-Vision-34B 2026.01		68.3
DeepEyes-7B 2026.01		68.2
QWEN2.5-VL-7B-INSTRUCT 2026.01		67.9
MMedAgentRL-7B 2026.01		67.9
HUATUOGPT-VISION-7B 2026.01		67.8
Mini-o3-7B-vl 2026.01		67.8
GPT-4o 2026.01		67.4
LLAVA-med-34B 2026.01		67.3
PixelReasoner-RL-vl-7B 2026.01		67.3
MEVF 2026.02		66.8
Gemme 3 4B 2025.08		66.59
Gemme 3 4B 2025.10		66.59
MedVLThinker-7B RL 2025.08		65.79
MedVLThinker-7B 2025.10		65.79
Qwen2.5-VL-7B-Instruct 2025.08		65.71
Qwen2.5-VL-7B-Instruct 2025.10		65.71
BAN 2026.02		65.1
GPT-5-mini 2026.01		64.59
QWEN2.5-VL-3B-INSTRUCT 2026.01		63.5
MedVLThinker-3B RL 2025.08		63.38
MedVLThinker-3B 2025.10		63.38
Llava Med v1.5 Mistral 7B 2025.08		62.82
Llava Med V1.5 7B 2025.10		62.82
LLaVA-Med-7B 2026.01		61.97
Qwen2.5-VL-3B-Instruct 2025.08		61.3
Qwen2.5-VL-3B-Instruct 2025.10		61.3
Cold-start w/o Reasoning 2026.01		61
MEDVISTA-R1 2026.01		60.99
HuatuoV-34B 2025.12		57.87
Llava-Next-13B 2026.01		57.1
GPT-4o 2025.12		56.69
Phi3.5V-Med 2025.12		55.11
MedVLM-R1-2B 2026.01		54.3
Phi3.5V-Med 2025.12		53.54
SMR-Agents 2026.01		53.5
Qwen3vl-8B 2026.01		52.63
Med-R1-2B 2026.01		52.1
Phi3.5V-Med 2025.12		50.79

Showing 100 of 134 rows