MathVista
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MathVista | Score229.2 | 474 | |
| Mathematical Reasoning | MathVista | Accuracy89.2 | 382 | |
| Visual Mathematical Reasoning | MathVista | Accuracy85 | 366 | |
| Mathematical Multimodal Reasoning | MathVista | Accuracy85.6 | 258 | |
| Mathematical Reasoning | MathVista mini | Accuracy86.2 | 135 | |
| Mathematical Reasoning | MathVista (testmini) | Accuracy85.9 | 121 | |
| Multimodal Mathematical Reasoning | MathVista MINI | Accuracy0.878 | 111 | |
| Visual Mathematical Reasoning | MathVista (testmini) | Accuracy79.3 | 88 | |
| Mathematical Visual Question Answering | MathVista | Accuracy85.6 | 87 | |
| Mathematical Reasoning | MathVista mini (test) | Accuracy80.2 | 75 | |
| Multimodal Reasoning | MathVista | Accuracy85.9 | 72 | |
| Mathematical Reasoning | MathVista (test) | Accuracy84.44 | 66 | |
| Mathematical Reasoning | MathVista | MathVista74.8 | 55 | |
| Multimodal Mathematical Reasoning | MathVista mini (test) | Overall Accuracy77.1 | 48 | |
| Mathematical Reasoning in Vision | MathVista | MathVista Accuracy74.7 | 48 | |
| Multimodal Reasoning | MathVista | Accuracy83.5 | 46 | |
| Visual Mathematical Reasoning | MathVista | Score81.9 | 46 | |
| Mathematical Reasoning | MathVista | Accuracy (All)88.9 | 43 | |
| Geometry problem solving | MathVista GPS | Accuracy95.7 | 38 | |
| Mathematical Reasoning | MathVista mini | Score73.9 | 37 | |
| Mathematical Reasoning | MathVista MVistam | Accuracy73.4 | 36 | |
| Multimodal reasoning | MathVista | Pass@189.8 | 36 | |
| Multimodal mathematical reasoning | MathVista (test) | Accuracy74.2 | 34 | |
| Geometry | MathVista mini | Score55.2 | 32 | |
| Math Reasoning | MathVista | Score78.8 | 30 |
Showing 25 of 86 rows