Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on SimpleVQA (Accuracy)

0.743Accuracy

Gemini-2.5 Pro

Updated 4d ago

Evaluation Results

Method	Links
Gemini-2.5 Pro 2026.05		0.743
Gemini-3-Flash 2026.04		0.737
Gemini-2.5 Pro 2026.05		0.727
Qwen3-VL-30B + ODE-RL 2026.05		0.71
Qwen3-VL-8B + ODE-RL 2026.05		0.703
Qwen3-VL-30B + ODE-SFT 2026.05		0.703
SenseNova-MARS-8B 2026.04		0.702
POINTS-Seeker-8B 2026.04		0.688
Gemini-2.5 Flash 2026.04		0.686
Qwen3-VL-8B + ODE-SFT 2026.05		0.683
MM-DeepResearch 32B 2026.03		0.676
GPT-5 2026.05		0.673
Gemini-2.5 Flash 2026.05		0.673
Gemini-2.5 Flash 2026.05		0.67
GoG-3-8B-Think-RL 2026.01		0.6644
GPT-5 2026.05		0.66
MM-DeepResearch-8B 2026.03		0.659
MM-DeepResearch-8B 2026.04		0.659
GoG-3-8B-Think-SFT 2026.01		0.6565
MIA 2026.04		0.649
GoG-2.5-7B-RL 2026.01		0.6486
Qwen3-VL-30B 2026.05		0.637
GPT-4o 2026.03		0.636
Unsupervised MIA 2026.04		0.633
DR-MMSearchAgent 2026.04		0.632
No Memory 2026.04		0.63
Qwen3-VL-8B-Think 2026.01		0.6269
ExpeL 2026.04		0.625
Qwen3-VL-8B 2026.03		0.623
MM-DeepResearch-7B 2026.03		0.62
Qwen3-VL-8B-Thinking 2026.01		0.619
Memento 2026.04		0.619
SenseNova-MARS-8B 2026.03		0.617
GPT-5 2026.04		0.617
GPT-4o 2026.04		0.616
ERNIE 5.0-Base 2026.02		0.6154
GoG-2.5-7B-SFT 2026.01		0.6061
RAG 2026.04		0.605
ReasoningBank 2026.04		0.604
DeepEyes-v2-7B 2026.03		0.594
DeepEyesV2 2025.11		0.594
Deepeyes2 2026.04		0.594
DeepEyesV2 2026.04		0.594
Deepeyes2 2026.04		0.594
Claude-3.7-Sonnet 2026.04		0.593
Qwen2.5-VL-7B 2026.01		0.5913
WebWatcher-32B 2026.03		0.59
WebWatcher-32B 2026.04		0.59
WebWatcher-32B 2026.05		0.59
Qwen3-VL-32B 2026.03		0.587
Qwen-2.5-VL-72B 2026.04		0.586
Qwen3-VL-32B 2026.03		0.58
MMSearch-R1-7B 2026.03		0.574
MMSearch-R1 2025.11		0.574
MMSearch-R1-7B 2026.04		0.574
MMSearch-R1 2026.04		0.574
MMSearch-R1-7B 2026.05		0.574
GPT-5 mini 2026.05		0.568
Mem0 2026.04		0.567
GPT-5 2026.03		0.559
DeepMMSearch-R1 2026.04		0.559
DeepMMSearch-R1-7B 2026.04		0.559
DeepMMSearch-R1 2026.04		0.559
DeepMMSearch-R1-7B 2026.03		0.558
GPT-5.4 2026.04		0.555
Gemini-2.5 Flash 2026.04		0.555
MMSearch-R1 2026.04		0.553
MMSearch-R1* 2026.01		0.5479
RLR³ 2026.05		0.546
WebWatcher-7B 2026.03		0.543
WebWatcher 2025.11		0.543
WebWatcher 2026.04		0.543
WebWatcher-7B 2026.04		0.543
WebWatcher 2026.04		0.543
WebWatcher-7B 2026.05		0.543
Official thinking 2026.05		0.543
GPT-5 2026.03		0.541
RLVR 2026.05		0.54
Gemini 2.5 Pro 2025.11		0.534
Gemini-2.5-Pro 2026.04		0.534
Gemini2.5 Pro 2026.04		0.534
RLR³ 2026.05		0.534
Omni 2026.04		0.533
CLAIMDIFF-RL actor-only 2026.05		0.532
Qwen3-VL-30B 2026.05		0.53
Qwen3-VL-8B 2026.05		0.53
RLVR 2026.05		0.529
Qwen3-VL-30B A3B-Instruct 2025.12		0.527
Qwen3-VL-30B-A3B-Instruct 2026.04		0.527
Qwen3VL-32B-Instruct 2026.05		0.527
Official instruct 2026.05		0.527
RLR³ 2026.05		0.524
Gemini-2.5 flash-lite 2025.12		0.522
RLVR 2026.05		0.521
Qwen3-VL-8B 2026.03		0.52
GPT-4o 2026.03		0.517
Qwen-2.5-VL 2025.11		0.516
A-Mem 2026.04		0.516
Qwen3-VL-8B 2026.05		0.513
Step-GUI-8B 2025.12		0.508

Showing 100 of 164 rows