Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on SimpleVQA (Accuracy)

0.7818Accuracy

GPT-5.2

Updated 29d ago

Evaluation Results

Method	Links
GPT-5.2 2026.06		0.7818
Gemini-3-Pro 2026.06		0.7591
Gemini-2.5 Pro 2026.05		0.743
Gemini-3-Flash 2026.04		0.737
TAPO 2026.06		0.7364
Gemini-2.5 Pro 2026.05		0.727
Qwen3-VL-30B + ODE-RL 2026.05		0.71
GPT-5 2026.06		0.7058
Qwen3-VL-8B-Instruct+SAPO 2026.06		0.7038
Qwen3-VL-8B + ODE-RL 2026.05		0.703
Qwen3-VL-30B + ODE-SFT 2026.05		0.703
SenseNova-MARS-8B 2026.04		0.702
SenseNova-MARS 2026.06		0.7019
Gemini-2.5-Flash 2026.06		0.6881
POINTS-Seeker-8B 2026.04		0.688
Gemini-2.5 Flash 2026.04		0.686
Qwen3-VL-8B + ODE-SFT 2026.05		0.683
Gemini-3-Flash 2026.06		0.6792
MM-DeepResearch 32B 2026.03		0.676
GPT-5 2026.05		0.673
Gemini-2.5 Flash 2026.05		0.673
Gemini-2.5 Flash 2026.05		0.67
GoG-3-8B-Think-RL 2026.01		0.6644
GPT-5 2026.05		0.66
MM-DeepResearch-8B 2026.03		0.659
MM-DeepResearch-8B 2026.04		0.659
GoG-3-8B-Think-SFT 2026.01		0.6565
Qwen2.5-VL-32B-Instruct 2026.06		0.6515
MIA 2026.04		0.649
GoG-2.5-7B-RL 2026.01		0.6486
Qwen3-VL-32B-Instruct 2026.06		0.6417
Gemini-3-Pro 2026.06		0.6407
Qwen3-VL-30B 2026.05		0.637
GPT-4o 2026.06		0.6367
GPT-4o 2026.03		0.636
Gemini-3-Flash 2026.06		0.6357
Unsupervised MIA 2026.04		0.633
DR-MMSearchAgent 2026.04		0.632
No Memory 2026.04		0.63
Qwen3-VL-8B-Think 2026.01		0.6269
ExpeL 2026.04		0.625
Qwen3-VL-8B 2026.03		0.623
Qwen3-VL-8B-Instruct 2026.06		0.6229
MM-DeepResearch-7B 2026.03		0.62
Qwen3-VL-8B-Thinking 2026.01		0.619
Memento 2026.04		0.619
SenseNova-MARS-8B 2026.03		0.617
GPT-5 2026.04		0.617
GPT-5 2026.06		0.617
GPT-4o 2026.04		0.616
ERNIE 5.0-Base 2026.02		0.6154
GoG-2.5-7B-SFT 2026.01		0.6061
RAG 2026.04		0.605
ReasoningBank 2026.04		0.604
GPT-5.2 2026.06		0.5992
DeepEyes-v2-7B 2026.03		0.594
DeepEyesV2 2025.11		0.594
Deepeyes2 2026.04		0.594
DeepEyesV2 2026.04		0.594
Deepeyes2 2026.04		0.594
DeepEyesV2 2026.06		0.594
Claude-3.7-Sonnet 2026.04		0.593
Qwen2.5-VL-7B 2026.01		0.5913
WebWatcher-32B 2026.03		0.59
WebWatcher-32B 2026.04		0.59
WebWatcher-32B 2026.05		0.59
Qwen3-VL-32B 2026.03		0.587
Qwen-2.5-VL-72B 2026.04		0.586
Qwen3-VL-32B 2026.03		0.58
MMSearch-R1-7B 2026.03		0.574
MMSearch-R1 2025.11		0.574
MMSearch-R1-7B 2026.04		0.574
MMSearch-R1 2026.04		0.574
MMSearch-R1-7B 2026.05		0.574
MMSearch-R1 2026.06		0.574
GPT-5 mini 2026.05		0.568
Mem0 2026.04		0.567
GPT-5 2026.03		0.559
DeepMMSearch-R1 2026.04		0.559
DeepMMSearch-R1-7B 2026.04		0.559
DeepMMSearch-R1 2026.04		0.559
DeepMMSearch-R1 2026.06		0.5587
DeepMMSearch-R1-7B 2026.03		0.558
GPT-5.4 2026.04		0.555
Gemini-2.5 Flash 2026.04		0.555
Gemini-2.5-Flash 2026.06		0.5548
MMSearch-R1 2026.04		0.553
MMSearch-R1* 2026.01		0.5479
RLR³ 2026.05		0.546
WebWatcher-7B 2026.03		0.543
WebWatcher 2025.11		0.543
WebWatcher 2026.04		0.543
WebWatcher-7B 2026.04		0.543
WebWatcher 2026.04		0.543
WebWatcher-7B 2026.05		0.543
Official thinking 2026.05		0.543
GPT-5 2026.03		0.541
RLVR 2026.05		0.54
Gemini 2.5 Pro 2025.11		0.534
Gemini-2.5-Pro 2026.04		0.534

Showing 100 of 225 rows