Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MathVista

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningMathVista
Score229.2
474
Mathematical ReasoningMathVista
Accuracy89.2
382
Visual Mathematical ReasoningMathVista
Accuracy85
366
Mathematical Multimodal ReasoningMathVista
Accuracy85.6
258
Mathematical ReasoningMathVista mini
Accuracy86.2
135
Mathematical ReasoningMathVista (testmini)
Accuracy85.9
121
Multimodal Mathematical ReasoningMathVista MINI
Accuracy0.878
111
Visual Mathematical ReasoningMathVista (testmini)
Accuracy79.3
88
Mathematical Visual Question AnsweringMathVista
Accuracy85.6
87
Mathematical ReasoningMathVista mini (test)
Accuracy80.2
75
Multimodal ReasoningMathVista
Accuracy85.9
72
Mathematical ReasoningMathVista (test)
Accuracy84.44
66
Mathematical ReasoningMathVista
MathVista74.8
55
Multimodal Mathematical ReasoningMathVista mini (test)
Overall Accuracy77.1
48
Mathematical Reasoning in VisionMathVista
MathVista Accuracy74.7
48
Multimodal ReasoningMathVista
Accuracy83.5
46
Visual Mathematical ReasoningMathVista
Score81.9
46
Mathematical ReasoningMathVista
Accuracy (All)88.9
43
Geometry problem solvingMathVista GPS
Accuracy95.7
38
Mathematical ReasoningMathVista mini
Score73.9
37
Mathematical ReasoningMathVista MVistam
Accuracy73.4
36
Multimodal reasoningMathVista
Pass@189.8
36
Multimodal mathematical reasoningMathVista (test)
Accuracy74.2
34
GeometryMathVista mini
Score55.2
32
Math ReasoningMathVista
Score78.8
30
Showing 25 of 86 rows