Share your thoughts, 1 month free Claude Pro on usSee more

Diagram Question Answering on AI2D (test)

94.7Accuracy

Claude 3.5

Updated 1mo ago

Evaluation Results

Method	Links
Claude 3.5 2024.07		94.7
Claude 3.5 Sonnet 2024.12		94.7
Gemini 1.5 Pro 2024.07		94.4
Gemini-1.5-Pro 2024.12		94.4
Gemini 1.5 Pro 2024.12		94.4
GPT-4o 2024.07		94.2
GPT-4o 2024.12		94.2
GPT-4o 2024.12		94.2
NVLM-D-1.0 2024.12		94.2
Llama 3-V 405B 2024.07		94.1
NVILA 2024.12		94.1
GenRecal 2025.06		93.9
Llama 3-V 70B 2024.07		93
GenRecal 2025.06		93
NVILA 2024.12		92.3
Llama 3.2 2024.12		92.3
NVILA-Lite 2024.12		92
Llama 3.2 2024.12		91.9
GenRecal 2025.06		91.8
NVILA-Lite 2024.12		91
GenRecal 2025.06		90
GenRecal 2025.06		89.1
VILA-1.5 2024.12		88.9
InternVL2 2024.12		87.1
LLaVA-OneVision 2024.12		85.6
Qwen3-VL-32B-Instruct 2026.03		85
InternVL2.5 2025.06		84.8
Phi-4-reasoning-vision-15B 2026.03		84.8
Qwen3-VL-32B-Instruct 2026.03		84.8
Phi-4-reasoning-vision-15B 2026.03		84.7
GPT-4o 2024.09		84.6
Kimi-VL-A3B-Instruct 2026.03		84.6
Llama 3-V 8B 2024.07		84.4
Qwen2.5VL 2025.12		83.9
InternVL2 2024.12		83.8
PVC InternVL2 (Ours) 2024.12		83.8
InternVL2 2024.12		83.8
InternVL2 2025.06		83.8
Qwen2-VL-Instruct 2024.12		83
Qwen2-VL 2024.12		83
Qwen2-VL 2024.12		83
InternVL-2-26B 2026.01		83
Qwen3-VL-8B-Instruct 2026.03		83
GenRecal 2025.06		82.9
Qwen3-VL-8B-Instruct 2026.03		82.7
DiffusionVL 2025.12		82.2
InternVL-2-8B 2026.01		82.2
MiniCPM-V2.6 2025.06		82.1
LLaVA-OV (SI) 2024.12		81.6
Qwen2.5VL 2025.12		81.6
IXC-2.5 2024.12		81.5
LLaVA-OV 2024.12		81.4
LLaVA-OV 2024.12		81.4
LLaVA-OneVision 2024.12		81.4
LLaVA-OV 2025.12		81.4
LLaVA-OneVision 2025.06		81.4
InternVL2.5 2025.06		81.4
gemma-3-12b-it 2026.03		80.4
VILA-1.5 2024.12		79.9
Cambrian-34B 2024.09		79.7
Cambrian-1 2024.12		79.7
Gemini-1.5-Pro 2024.09		79.1
Pixtral 2024.12		79
InternVL2 2025.06		78.9
LLaVA-NeXT-INST-IT 2024.12		78.7
Oryx MLLM 2024.12		78.5
DiffusionVL 2025.12		78.4
MiniCPM-V2.5 2025.06		78.4
GPT-4V 2024.07		78.2
GPT-4V 2024.12		78.2
LLaVA-OV-7B w/ CLI 2026.01		77.9
LLaDA-V 2025.12		77.8
Phi-3.5-Vision 2025.06		77.8
LLaVA-OV-7B w/ SLI 2026.01		77.6
LLaVA-OV-7B 2026.01		77.5
Qwen2-VL 2025.06		77.5
MM1.5-30B 2024.09		77.2
Phi-3-Vision-4B 2024.09		76.7
VILA-1.5 2024.12		76.6
PVC InternVL2 (Ours) 2024.12		76.3
Eagle 2025.06		76.1
LLaVA-OV-7B w/ DeepStack 2026.01		76
GPT-4V 2024.09		75.9
Aquila-VL 2025.06		75
InternVL2.5 2025.06		74.9
Qwen2-VL 2024.12		74.7
Dimple 2025.12		74.4
Florence-VL 2024.12		74.2
InternVL2-2B 2024.09		74.1
InternVL2 2024.12		74.1
InternVL2 2025.06		74.1
Eagle 2025.06		74
Cambrian-1 2024.12		73.6
Cambrian-1 2025.06		73.6
LLaVA-NeXT-Qwen2 2024.06		73.5
CogVLM2 2025.06		73.4
MM1-30B 2024.09		73.3
LongVA 2024.06		73.1
Cambrian-1 2024.12		73
Cambrian-1 2025.12		73

Showing 100 of 142 rows