Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MathVista

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningMathVista
Score229.2
385
Visual Mathematical ReasoningMathVista
Accuracy85
278
Mathematical ReasoningMathVista
Accuracy89.2
257
Mathematical Multimodal ReasoningMathVista
Accuracy85.6
218
Mathematical ReasoningMathVista (testmini)
Accuracy85.9
103
Mathematical ReasoningMathVista mini
Accuracy83.9
102
Multimodal Mathematical ReasoningMathVista MINI
Accuracy0.878
90
Mathematical ReasoningMathVista mini (test)
Accuracy80.2
75
Multimodal ReasoningMathVista
Accuracy85.9
72
Mathematical ReasoningMathVista (test)
Accuracy70.52
59
Multimodal Mathematical ReasoningMathVista mini (test)
Overall Accuracy77.1
48
Visual Mathematical ReasoningMathVista (testmini)
Accuracy79.3
48
Mathematical Reasoning in VisionMathVista
MathVista Accuracy74.7
48
Mathematical Visual Question AnsweringMathVista
Accuracy85.6
47
Mathematical ReasoningMathVista
Accuracy (All)88.9
43
Geometry problem solvingMathVista GPS
Accuracy95.7
38
Multimodal reasoningMathVista
Pass@189.8
36
Multimodal mathematical reasoningMathVista (test)
Accuracy74.2
34
GeometryMathVista mini
Score55.2
32
STEM / Multimodal ReasoningMathVista
Accuracy83.97
28
Math & KnowledgeMathVista mini
Accuracy85.9
25
Math ReasoningMathVista
Pass@174.6
24
Mathematical ReasoningMathVista 96 (testmini)
Score89.1
23
Multimodal Mathematical ReasoningMathVista testmini
Score63
23
Mathematical ReasoningMathVista F
Accuracy49
23
Showing 25 of 65 rows