MathVista
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MathVista | Score229.2 | 322 | |
| Visual Mathematical Reasoning | MathVista | Accuracy85 | 189 | |
| Mathematical Reasoning | MathVista | Accuracy89.2 | 97 | |
| Mathematical Reasoning | MathVista mini | Accuracy80.1 | 72 | |
| Mathematical Reasoning | MathVista mini (test) | Accuracy80.2 | 67 | |
| Mathematical Reasoning | MathVista (test) | Accuracy65.3 | 55 | |
| Mathematical Reasoning | MathVista (testmini) | Accuracy85.9 | 51 | |
| Mathematical Reasoning in Vision | MathVista | MathVista Accuracy74.7 | 48 | |
| Mathematical Multimodal Reasoning | MathVista | Accuracy85.6 | 46 | |
| Geometry problem solving | MathVista GPS | Accuracy95.7 | 38 | |
| Multimodal Mathematical Reasoning | MathVista MINI | Accuracy0.821 | 35 | |
| Multimodal Mathematical Reasoning | MathVista mini (test) | Overall Accuracy77.1 | 33 | |
| Visual Mathematical Reasoning | MathVista (testmini) | Accuracy67.7 | 33 | |
| Multimodal reasoning | MathVista | Pass@185.6 | 30 | |
| Multimodal Reasoning | MathVista | Accuracy85.9 | 29 | |
| Math & Knowledge | MathVista mini | Accuracy85.9 | 25 | |
| Mathematical Reasoning | MathVista | Accuracy (All)79.5 | 23 | |
| Mathematical Reasoning | MathVista 96 (testmini) | Score89.1 | 23 | |
| Mathematical Reasoning | MathVista F | Accuracy49 | 23 | |
| Math Reasoning | MathVista | Pass@174.6 | 19 | |
| Mathematical Reasoning | MathVista Math | ALL Accuracy81.11 | 19 | |
| Mathematical Reasoning | MathVista MVistam | Accuracy73.4 | 18 | |
| Multimodal mathematical reasoning | MathVista (test) | Accuracy74.2 | 17 | |
| Multimodal Math Reasoning | MathVista In-domain | Overall Accuracy65.3 | 16 | |
| Multimodal Mathematical Reasoning | MathVista | GPS Score85.1 | 15 |
Showing 25 of 42 rows