Our new X account is live! Follow @wizwand_team for updates

Medical Visual Question Answering on OmniMedVQA (test)

85.1CT Accuracy

M3LLM-8B

Updated 3d ago

Evaluation Results

Method
M3LLM-8B 2025.11	85.1	85.5	89.3	90.2	79.8	83.6	88.7	78.2	85.7	-	-	-
InternVL3-8B 2025.11	78.9	87.5	80.4	77.2	81.8	82.2	87.3	76.4	79	-	-	-
Lingshu-7B 2025.11	77.2	88.9	83.3	89.9	83.2	82.7	86.4	80.6	82.8	-	-	-
MedGemma-27B 2025.11	75.5	80.8	66.1	76.3	74	66.1	78.5	55.8	70.3	-	-	-
HealthGPT-14B 2025.11	70.3	82.5	83.6	88	69	72.7	83.7	56.7	75.8	-	-	-
HuatuoGPT-Vision-7B 2025.11	70	84.2	72.1	85.7	72.5	75.7	81.9	81.2	77.9	-	-	-
Qwen3-VL 2026.01	68	-	-	85	83.67	81.67	86.33	66.33	79.33	79.33	84.33	79.33
Qwen3-VL 2026.01	66.33	-	-	78.67	77	80.67	84	62.67	75.42	77.67	76.33	75.1
Qwen3-VL 2026.01	65.67	-	-	63.33	67.33	82	81.33	58.67	69.42	70	67	69.33
HuatuoGPT 2026.01	62.67	-	-	76.33	64	63.33	69.33	49.67	65.29	67.33	69.67	65
QWen2.5-VL-7B 2025.11	62.5	70.8	66.4	66.2	68	70.9	76.8	35.6	64.7	-	-	-
Qwen3-VL 2026.01	62	-	-	75.33	76.67	84	85.67	61.67	74.75	73.67	79	74.91
KEPO (τ = 1) 2026.01	62	-	-	82.33	78.67	81.67	85	74	80.25	96	82.33	78
KEPO - KE (τ = 1) 2026.01	55.33	-	-	77.33	74.67	83.67	81	72	76.29	83.67	82.67	75.24
KEPO (τ = 0) 2026.01	54.67	-	-	78	79	83.67	82.67	72.33	78.71	95.67	83.67	76.29
KEPO - KE (τ = 0) 2026.01	53.33	-	-	75.67	82	84.33	81.33	72.67	75.58	81.33	74	74.76
SFT Base 2026.01	53	-	-	67.67	64.67	78	79.67	55.33	69.79	85.33	74.67	67.57
On-policy KD (λ = 1) 2026.01	52.67	-	-	58.33	67	73.67	79.67	75	65.92	59.67	61.33	66.81
GRPO Base 2026.01	51	-	-	73.33	75	84	78	73	74.33	79	81.33	73.67
Supervised KD (λ = 0) 2026.01	50.67	-	-	73	73.33	83.33	78	74.67	73.92	78.67	79.67	73.24
Qwen3-VL 2026.01	50.33	-	-	55.33	68.33	75.67	79.67	74.33	67.46	64	72	67.95
Mixed KD (λ = 0.5) 2026.01	49.33	-	-	73	70.67	82.33	77.67	74.33	73.04	77.67	79.33	72.38
Qwen3-VL 2026.01	48.67	-	-	68.67	68	79.33	79	73.33	69.42	61.33	77	70.57
On-policy KD (λ = 1) 2026.01	48.67	-	-	73	71.33	82.67	78.67	74.67	73.13	78.33	77.67	72.38
KEPO - KE (τ = 0) 2026.01	48.33	-	-	73	70	80.33	77	71.67	71.33	77.67	79	72.13
GRPO Base 2026.01	48	-	-	73.67	71.67	80	78.33	72.33	73.12	80	81	72.14
LLaVA-Med-7B 2025.11	38.7	48.3	39.5	45.7	58.8	49.3	43.4	48.1	46.5	-	-	-
LLaVA-NeXT-7B 2025.11	31.7	27	24.6	25.7	30.2	26.6	25.8	25.5	27.1	-	-	-
LLaVA-7B 2025.11	30.7	26.1	23.9	24.8	30.7	26.4	23	25.1	26	-	-	-