SOTA Visual Question Answering on LiveVQA and PapersWithCode

77.6Accuracy

Vision-DeepResearch-30B-A3B

Updated 4d ago

Evaluation Results

Method
Vision-DeepResearch-30B-A3B 2026.01	77.6	-
Vision-DeepResearch-8B 2026.01	76.7	-
Gemini-2.5 Pro 2026.01	76	-
GPT-5 2026.01	73.3	-
Gemini-2.5 Flash 2026.01	73	-
Claude-3.7-Sonnet 2026.01	72	-
Claude-4-Sonnet 2026.01	69.7	-
Qwen3-VL-8B-Instruct 2026.01	63	-
Qwen3-VL-30B-A3B-Thinking 2026.01	62	-
Gemini-2.5 Pro 2026.01	60.3	-
Qwen3-VL-30B-A3B-Instruct 2026.01	60	-
Webwatcher-32B 2026.01	58.7	-
GPT-5 2026.01	57.5	-
Qwen3-VL-8B-Thinking 2026.01	56.3	-
Webwatcher-7B 2026.01	51.2	-
Gemini-2.5 Flash 2026.01	51	-
Qwen3-VL-30B-A3B-Thinking 2026.01	49	-
MMSearch-R1-7B 2026.01	48.4	-
GoG-3-8B-Think-RL 2026.01	43.85	-
Qwen3-VL-8B-Thinking 2026.01	43.3	-
Qwen3-VL-30B-A3B-Instruct 2026.01	42.7	-
Gemini-2.5-flash 2026.01	41.3	-
Qwen3-VL-8B-Instruct 2026.01	41	-
Claude-4-Sonnet 2026.01	38.5	-
Claude-3.7-Sonnet 2026.01	38	-
GoG-2.5-7B-RL 2026.01	37.7	-
Qwen-2.5-VL-72B 2026.01	35.7	-
GoG-3-8B-Think-SFT 2026.01	32.4	-
Qwen2.5-VL-7B 2026.01	31.05	-
Claude-3.7-Sonnet 2026.01	30.3	-
Qwen3-VL-8B-Think 2026.01	25.95	-
GoG-2.5-7B-SFT 2026.01	24.55	-
MMSearch-R1* 2026.01	23.85	-
Qwen3-VL-8B-Thinking 2026.01	23.55	-
Qwen3-VL-30B-A3B-Thinking 2026.01	15.4	-
Qwen3-VL-8B-Thinking 2026.01	15.15	-
GPT-4o 2026.01	14.8	-
Qwen2.5-VL-32B 2026.01	12.7	-
Qwen3-VL-30B-A3B-Instruct 2026.01	12.6	-
Qwen3-VL-8B-Instruct 2026.01	11.4	-
Qwen2.5-VL-7B 2026.01	10.4	-
Qwen2.5-VL-7B 2026.01	10.3	-
Gemini-2.5-Flash 2026.02	-	73
Gemini-2.5-Pro 2026.02	-	76
Seed1.8 2026.02	-	62.4
GPT-5 2026.02	-	73.3
Gemini-3-Pro 2026.02	-	79.9
Qwen2.5-VL 2026.02	-	35.7
Qwen3-VL Thinking 2026.02	-	64.8
Qwen3-VL Thinking 2026.02	-	70.2
MMSearch-R1 2026.02	-	48.4
WebWatcher 2026.02	-	58.7
Vision-DeepResearch 2026.02	-	77.6
REDSearcher-MM-SFT 2026.02	-	78.5
REDSearcher-MM-RL 2026.02	-	79.3