Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Question Answering on PathMMU (val)

80.1Overall Accuracy

PathoSage

Updated 1mo ago

Evaluation Results

Method
PathoSage 2026.05	80.1	82.5	78.8	71.9	86.3	76
Gemini-3-Pro-Preview 2026.05	74.5	80	69.2	72.9	81.5	66.7
PathoSage 2026.05	74	75	69.9	65.6	80.7	72.7
Gemini-3-Flash-Preview 2026.05	73.2	81.3	74.7	67.7	75.5	67.3
GPT-5.4 2026.05	65.4	70	58.9	58.3	71.2	64.7
Patho-R1 2026.05	63	82.5	63	41.7	64	64.7
Patho-R1-7B 2025.05	62.98	82.5	63.01	41.67	63.95	64.67
GPT-5.4-mini 2026.05	61.8	70	56.9	46.9	68.2	62
Qwen3-VL-Instruct 2026.05	59.7	71.2	61.6	40.6	61.4	61.3
Patho-R1-3B 2025.05	58.44	71.25	60.27	33.33	62.66	59.33
PathGen-LLaVA 2026.05	58.2	67.5	61	50	59.7	53.3
PathGen-LLaVA-13B 2025.05	58.16	67.5	60.96	50	59.66	53.33
HuatuoGPT-Vision-7B 2025.05	54.61	61.25	54.11	38.54	55.36	60.67
HuatuoGPT 2026.05	54.6	61.3	54.1	38.5	55.4	60.7
PathNavigate 2026.05	53.6	-	-	-	-	-
Qwen3-VL-Instruct 2026.05	53.5	57.5	54.1	43.8	53.6	56.7
PathAgent 2026.05	52.84	-	-	-	-	-
MedGemma-1.5-4B 2026.05	50.62	-	-	-	-	-
InternVL3 2026.05	49.8	52.5	45.9	40.6	52.4	54
InternVL3-8B 2025.05	49.79	52.5	45.89	40.63	52.36	54
InternVL2.5-8B 2025.05	47.8	46.25	52.05	33.33	47.64	54
InternVL2.5 2026.05	47.8	46.3	52.1	33.3	47.6	54
Qwen3.5-9B 2026.05	45.84	-	-	-	-	-
Llama-3.2V-11B-cot 2025.05	45.82	46.25	42.47	35.42	47.64	52.67
Qwen2.5VL-3B 2025.05	45.67	52.5	45.89	28.13	51.07	44.67
Patho-R1 only 2026.05	42.18	-	-	-	-	-
InternVL2-8B 2025.05	40.28	41.25	41.1	23.96	42.92	45.33
Qwen2.5VL-7B 2025.05	38.44	43.75	34.93	29.17	39.91	42.67
Qwen3.5-4B 2026.05	38.16	-	-	-	-	-
Llama-3.2-11B-Vision-Instruct 2025.05	37.45	46.25	36.3	32.29	36.05	39.33
SlideChat 2026.05	37.42	-	-	-	-	-
WSI-LLaVA 2026.05	36.18	-	-	-	-	-
Quilt-LLaVA 2026.05	33.1	45	32.9	17.7	34.3	34.7
Quilt-LLaVA-v1.5-7B 2025.05	33.05	45	32.88	17.71	34.33	34.67
TITAN 2026.05	32.18	-	-	-	-	-
DeepSeek-VL2-Tiny 2025.05	29.08	36.25	28.77	17.71	28.33	34
VILA1.5-3B 2025.05	27.23	22.5	27.4	16.67	31.33	30
Quilt-LLaVA 2026.05	26.5	-	-	-	-	-
Llama3.2-3B-vl 2025.05	25.25	36.25	26.03	7.29	27.9	26
Random choice 2026.05	25	-	-	-	-	-
LLaVA-Onevision-7B 2025.05	23.4	20	19.18	16.67	30.04	23.33
LLaVA-Onevision 2026.05	23.4	20	19.2	16.7	30	23.3
LLaVA-Med 2026.05	17.9	22.5	20.6	7.3	18.9	18
LLaVA-Med-v1.5-Mistral-7B 2025.05	17.87	22.5	20.55	7.29	18.88	18
Paligemma2-3b-pt-224 2025.05	1.28	1.25	1.37	0	2.15	0.67