Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on FetUS-VQA 1.0 (test)

99.47Task 1 Accuracy

FetUSAgents

Updated 8d ago

Evaluation Results

Method	Links
FetUSAgents 2026.05		99.47	71.88	93.32	90.86	93.99	93.13	92.95	92.95	100	50.59	87.91
Qwen3-VL-30B-A3B 2026.05		45.99	40.62	50.26	41.83	62.66	48.93	40.9	74.56	33.33	33.2	47.23
Doubao-Seed-2.0-Pro 2026.05		44.92	53.12	62.04	58.17	82.4	76.39	83.56	72.41	33.33	30.83	59.72
Qwen3-MAX 2026.05		44.39	59.38	50.09	38.31	49.36	27.9	25.05	71.23	29.33	30.83	42.59
Hulu-Med-30A3 2026.05		36.9	43.75	58.88	40.6	63.09	71.67	38.75	74.56	24	24.11	47.63
Hulu-Med-32B 2026.05		34.22	56.26	59.75	41.83	70.39	60.09	43.64	74.95	21.33	31.62	49.41
GPT-5.4 2026.05		32.62	46.88	56.41	41.12	78.54	75.11	80.43	82.78	40	10.67	54.46
Gemini-3-Flash-Thinking 2026.05		32.09	50	71	73.11	91.85	90.56	78.28	75.34	44	20.95	62.72
GPT-5.1 2026.05		30.48	54.69	55.01	35.33	74.25	67.81	81.6	69.86	38.67	27.67	53.54
DeepSeek-V3.2 2026.05		29.95	45.31	50.09	40.07	48.07	27.9	74.56	73.58	29.33	27.67	44.65
MedGemma-27B 2026.05		25.67	62.5	57.29	44.64	57.08	37.77	74.56	74.56	28	28.06	49.01
Rand 2026.05		25	50	50	33.33	50	25	50	33.33	25	25	36.67
Llava-Med-V1.5-Mistral-7B 2026.05		19.79	59.38	41.48	44.11	48.93	27.47	25.44	74.56	24	26.88	39.6
HuatuoGPT-34B 2026.05		19.25	35.94	54.13	43.41	64.38	37.34	36.59	63.01	20	21.34	39.54