Share your thoughts, 1 month free Claude Pro on usSee more

Visual Question Answering on AI2D

88.4Accuracy

Gemini 2.5 Pro

Updated 3d ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2026.04		88.4
OpenVLThinkerV2 2026.04		87.5
Baseline 2026.01		87.3
PTQ 2026.01		86.8
QAD 2026.01		86.7
QAT 2026.01		86.5
EMOVA 2024.09		85.8
InternVL3 2025.10		85.2
OneThinker-8B 2026.04		85.2
Qwen3-VL GRPO 2026.04		85.1
Qwen3-VL GDPO 2026.04		85.1
GPT-4o 2026.04		84.9
VisionZero 2026.04		84.8
GPT-4o 2024.09		84.6
InternVL2.5 2025.10		84.5
MM-Eureka-7B 2026.04		84.1
Qwen2.5-VL 2025.10		83.9
PTP 2025.09		83.8
NEO 2025.10		83.1
MoVA 2024.04		83
Qwen2-VL 2025.10		83
Encoder-Based 2025.10		82.9
FP16 Baseline 2026.03		82.42
InternVL2-8B 2025.09		82.4
RADIOv2.5-H + Tiling 2024.12		82.4
Qwen3-VL-Instruct-8B 2026.04		82.3
GSearch 2025.09		82.1
Vision-G1 2026.04		82.1
VTW 2025.09		81.8
OpenVLThinker-7B 2026.04		81.8
EMOVA 2024.09		81.7
Qwen2.5-VL 3B (reported) 2025.12		81.6
Qwen2.5-VL 2025.10		81.6
Qwen3-VL-4B-Instruct 2026.02		81.6
GeminiProVision 2024.06		81.4
FP16 Baseline 2026.03		81.31
PALI-X-55B 2023.08		81.2
PALI-X-55B 2024.04		81.2
MG-LLAVA 2024.06		81.1
FastV 2025.09		81.1
VL-Rethinker-7B 2026.04		80.8
RTN 2026.03		80.51
PDrop 2025.09		80.4
Gemini Pro 1.5 2024.09		80.3
FP16 Baseline 2026.03		80.12
Qwen2.5-VL 3B (reproduced) 2025.12		80.1
NEO 2025.10		80.1
QIG 2026.03		79.73
MBQ 2026.03		79.66
QIG 2026.03		79.63
AWQ 2026.03		79.47
MBQ 2026.03		79.47
VITA 2024.09		79.3
SigLIP SO400M + Tiling 2024.12		79.3
Eagle2 2025.07		79.3
QIG 2026.03		79.11
InstructVLA-Generalist 2025.07		79.1
RTN 2026.03		79.02
RTN 2026.03		78.92
LaViDa-R1 2026.02		78.9
InstructVLA-Generalist 2025.07		78.9
InternVL3 2025.10		78.7
Xiaomi-Robotics-0 2026.02		78.7
EMOVA 2024.09		78.6
LaViDa-O +SFT 2026.02		78.6
MBQ 2026.03		78.47
QIG 2026.03		78.3
MBQ 2026.03		78.27
GPT-4V 2024.09		78.2
AWQ 2026.03		77.92
QIG 2026.03		77.88
LLaDA-V 2026.01		77.82
RTN 2026.03		77.82
MBQ 2026.03		77.81
LLaDA-FastV 2026.01		77.75
AWQ 2026.03		77.53
Encoder-Based 2025.10		77.4
SQ 2026.03		77.2
QIG 2026.03		77.17
RTN 2026.03		77.01
MoVA 2024.04		77
GPTQ 2026.03		76.81
LaViDa-O 2026.02		76.7
SAIL 2025.10		76.7
GPTQ 2026.03		76.65
SQ 2026.03		76.59
MBQ 2026.03		76.49
BREEN 2025.10		76.4
RTN 2026.03		76.33
SQ 2026.03		76.07
LLaDA-FastV 2026.01		75.87
MG-LLAVA 2024.06		75.6
INF-LLaVA* 2024.07		75.42
CROME-Vicuna-7B 2024.08		75.3
MG-LLAVA 2024.06		75.1
CASA⊕ Qwen2.5-VL 2025.12		75.1
MoVA 2024.04		74.9
InternVL2.5 2025.10		74.9
GPTQ 2026.03		74.87
EVEv2 2025.10		74.8

Showing 100 of 249 rows