Share your thoughts, 1 month free Claude Pro on usSee more

Chart Understanding on ChartQA 1.0 (test)

90.8Avg Relaxed Accuracy

Claude-3.5-Sonnet

Updated 1mo ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2024.12		90.8
InternVL2-Llama3-76B 2024.12		88.4
Qwen2-VL-72B 2024.12		88.3
InternVL2.5-78B 2024.12		88.3
InternVL2.5-38B 2024.12		88.2
Molmo-72B 2024.12		87.3
InternVL2.5-26B 2024.12		87.2
Gemini-1.5-Pro 2024.12		87.2
InternVL2-40B 2024.12		86.2
NVLM-D-72B 2024.12		86
GPT-4o-20240513 2024.12		85.7
InternVL2-26B 2024.12		84.9
InternVL2.5-8B 2024.12		84.8
Molmo-7B-D 2024.12		84.1
InternVL2.5-4B 2024.12		84
InternVL-Chat-V1.5 2024.12		83.8
LLaVA-OneVision-72B 2024.12		83.7
InternVL2-8B 2024.12		83.3
Qwen2-VL-7B 2024.12		83
MiniCPM-V2.6 2024.12		82.4
Phi-3.5-Vision-4B 2024.12		81.8
InternVL2-4B 2024.12		81.5
Claude-3-Opus 2024.12		80.8
InternVL2.5-2B 2024.12		79.2
GPT-4V 2024.12		78.5
Aquila-VL-2B 2024.12		76.5
InternVL2-2B 2024.12		76.2
InternVL2.5-1B 2024.12		75.9
Cambrian-34B 2024.12		75.6
Qwen2-VL-2B 2024.12		73.5
InternVL2-1B 2024.12		72.9
VILA-1.5-40B 2024.12		67.2
LLaVA-OneVision-0.5B 2024.12		61.4