Share your thoughts, 1 month free Claude Pro on usSee more

Scientific Chart Understanding on CharXiv 1.0

60.2RQ Score

Claude-3.5-Sonnet

Updated 1mo ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2024.12		60.2	84.3
GPT-4o-20240513 2024.12		47.1	84.5
Gemini-1.5-Pro 2024.12		43.3	72
InternVL2.5-38B 2024.12		42.4	79.6
InternVL2.5-78B 2024.12		42.4	82.3
InternVL2-Llama3-76B 2024.12		38.9	75.2
GPT-4V 2024.12		37.1	79.9
InternVL2.5-26B 2024.12		35.9	73.5
InternVL2-26B 2024.12		33.4	62.4
InternVL2.5-8B 2024.12		32.9	68.6
InternVL2-40B 2024.12		32.3	66
InternVL2-8B 2024.12		31.2	56.1
MiniCPM-V2.6 2024.12		31	57.1
Claude-3-Opus 2024.12		30.2	71.6
InternVL-Chat-V1.5 2024.12		29.2	58.5
Cambrian-34B 2024.12		27.3	59.7
InternVL2.5-4B 2024.12		24.9	61.7
InternVL2-4B 2024.12		24.5	48
VILA-1.5-40B 2024.12		24	38.7
InternVL2.5-2B 2024.12		21.3	49.7
InternVL2-2B 2024.12		21	40.6
InternVL2.5-1B 2024.12		19	38.4
InternVL2-1B 2024.12		18.1	30.7