Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Question Answering on PathMMU (val)

82.5Accuracy (Atlas)

Patho-R1-7B

Updated 26d ago

Evaluation Results

Method	Links
Patho-R1-7B 2025.05		82.5	63.01	41.67	63.95	64.67	62.98
Patho-R1-3B 2025.05		71.25	60.27	33.33	62.66	59.33	58.44
PathGen-LLaVA-13B 2025.05		67.5	60.96	50	59.66	53.33	58.16
HuatuoGPT-Vision-7B 2025.05		61.25	54.11	38.54	55.36	60.67	54.61
Qwen2.5VL-3B 2025.05		52.5	45.89	28.13	51.07	44.67	45.67
InternVL3-8B 2025.05		52.5	45.89	40.63	52.36	54	49.79
InternVL2.5-8B 2025.05		46.25	52.05	33.33	47.64	54	47.8
Llama-3.2-11B-Vision-Instruct 2025.05		46.25	36.3	32.29	36.05	39.33	37.45
Llama-3.2V-11B-cot 2025.05		46.25	42.47	35.42	47.64	52.67	45.82
Quilt-LLaVA-v1.5-7B 2025.05		45	32.88	17.71	34.33	34.67	33.05
Qwen2.5VL-7B 2025.05		43.75	34.93	29.17	39.91	42.67	38.44
InternVL2-8B 2025.05		41.25	41.1	23.96	42.92	45.33	40.28
Llama3.2-3B-vl 2025.05		36.25	26.03	7.29	27.9	26	25.25
DeepSeek-VL2-Tiny 2025.05		36.25	28.77	17.71	28.33	34	29.08
VILA1.5-3B 2025.05		22.5	27.4	16.67	31.33	30	27.23
LLaVA-Med-v1.5-Mistral-7B 2025.05		22.5	20.55	7.29	18.88	18	17.87
LLaVA-Onevision-7B 2025.05		20	19.18	16.67	30.04	23.33	23.4
Paligemma2-3b-pt-224 2025.05		1.25	1.37	0	2.15	0.67	1.28