Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on PathMMU Tiny 1.0 (test)

72.4Overall Accuracy

CPath-Omni

Updated 27d ago

Evaluation Results

Method
CPath-Omni 2024.12	72.4	74	76.6	69.8	65.9	75.7
Expert performance 2024.12	71.8	72.9	71.5	69	68.3	78.9
Expert Performance 2026.01	71.8	72.9	71.5	69	68.3	78.9
Patho-R1-7B 2026.01	69.53	72.24	67.89	75.29	81.73	44.63
Patho-R1-7B 2025.05	69.53	72.24	67.89	75.29	81.73	44.63
PathReasoner-R1-7B 2026.01	67.7	69.39	68.08	70.98	73.55	56.49
Patho-R1-3B 2025.05	63.83	67.62	66.51	67.45	74.52	36.72
PathGen-LLaVA-13B 2025.05	61.9	62.28	59.63	62.35	68.27	55.93
PathReasoner-SFT-7B 2026.01	61.19	65.83	63.4	66.66	64.9	45.19
PathGen-LLaVA 2024.12	60.1	60.1	60.9	60.8	63.5	54.2
HuatuoGPT-Vision-7B 2026.01	58.21	61.92	58.72	60	65.87	40.11
HuatuoGPT-Vision-7B 2025.05	58.21	61.92	58.72	60	65.87	40.11
InternVL3.5-8B 2026.01	55.4	57.65	60.55	54.9	58.17	42.94
InternVL3-8B 2025.05	55.4	57.65	60.55	54.9	58.17	42.94
GPT-4V-1106 2024.12	53.9	59.4	58.7	60.4	48.1	36.2
InternVL2.5-8B 2025.05	50.13	55.87	57.8	50.59	51.44	29.38
Qwen-VL-MAX 2024.12	49.2	53	53.6	52.2	51.4	30.5
SlideChat-7B 2026.01	46.01	53.38	45.41	47.06	49.04	29.94
MedVLThinker-7B 2026.01	46.01	53.38	45.41	47.06	49.04	29.94
Llama-3.2V-11B-cot 2025.05	46.01	53.38	45.41	47.06	49.04	29.94
Quilt-LLaVA 2024.12	45.6	47.3	46.4	51.8	46.2	32.2
InternVL2-8B 2025.05	45.13	49.11	51.38	50.59	46.63	21.47
WSI-LLaVA-7B 2026.01	44.83	51	46	46.67	50	28.5
Qwen2.5VL-3B 2025.05	43.37	49.82	46.79	44.31	46.63	23.73
Gemini Pro Vision 2024.12	42.8	43.8	42.4	43.5	49.5	32.8
Qwen3-VL-8B-Thinking 2026.01	41.88	44.84	40.83	49.41	44.23	24.86
Qwen2.5VL-7B 2025.05	41.88	44.84	40.83	49.41	44.23	24.86
Llama-3.2-11B-Vision-Instruct 2025.05	39.07	39.5	41.74	38.04	45.19	29.38
LLaVA-1.5-13B 2024.12	38.8	44.5	40.4	34.1	47.1	24.9
InstructBLIP-FLAN-T5-XXL 2024.12	34.3	39.1	33.6	34.5	38.5	22.6
DeepSeek-VL2-Tiny 2025.05	34.24	38.79	36.7	33.73	38.46	19.77
Quilt-LLaVA-7B 2026.01	33.98	37.01	32.57	38.43	42.79	14.12
Quilt-LLaVA-v1.5-7B 2025.05	33.98	37.01	32.57	38.43	42.79	14.12
VILA1.5-3B 2025.05	27.57	34.88	23.85	29.41	28.85	16.38
MedGemma-4B-IT 2026.01	26.65	28.8	31.1	29.1	33.15	8.05
Llama3.2-3B-vl 2025.05	25.55	27.76	30.28	27.84	30.29	7.34
LLaVA-Med 2024.12	25.3	28.5	28.9	22.7	22.6	22.6
LLaVA-Med-7B 2026.01	23.79	31.32	18.35	21.18	31.25	13.56
LLaVA-Onevision-7B 2025.05	23.79	31.32	18.35	21.18	31.25	13.56
Qwen3-VL-8B-Instruct 2026.01	20.9	24.56	22.48	21.57	25	7.34
LLaVA-Med-v1.5-Mistral-7B 2025.05	20.9	24.56	22.48	21.57	25	7.34
Paligemma2-3b-pt-224 2025.05	1.32	2.14	0.92	1.96	0.96	0