Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Visual Question Answering on MATH-Vision Full (test)

73.3Relaxed Accuracy

Gemini 2.5 Pro

Updated 3mo ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2025.09		73.3
Human 2025.09		68.82
Qwen2.5-VL-7B-Instruct + Visual-TableQA 2025.09		49.77
Qwen2.5-VL-7B-Instruct + ReachQA 2025.09		48.57
Llama 4 Maverick 17B-128E Instruct 2025.09		45.89
Gemini 2.5 Flash 2025.09		41.3
Qwen2.5-VL-32B-Instruct 2025.09		38.1
Claude 3.5 Sonnet 2025.09		32.76
Mistral Small 3.1 24B Instruct 2025.09		32.45
GPT-4o 2025.09		30.39
GPT-4o mini 2025.09		28.85
Qwen2.5-VL-7B-Instruct 2025.09		25.1