MathVision
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Mathematical Reasoning | MathVision | Accuracy87.27 | 63 | |
| Mathematical reasoning | MathVision (test) | Accuracy71.9 | 41 | |
| Mathematical Reasoning | MathVision | Accuracy75.95 | 38 | |
| Multi-modal Reasoning | MathVision (test) | Accuracy (%)47.7 | 32 | |
| Multimodal Math Reasoning | MathVision | Accuracy68.7 | 31 | |
| Multimodal reasoning | MathVision | Pass@173.3 | 23 | |
| Mathematical Reasoning | MathVision MVisionm | Accuracy41.3 | 18 | |
| Step-wise Verification | MathVision | Macro F161.7 | 18 | |
| Multimodal mathematical reasoning | MathVision (test) | Accuracy39.3 | 17 | |
| Multimodal mathematical reasoning | MathVision | Pass@1 Accuracy58.75 | 11 | |
| General Perception and Reasoning | MathVision | Score58.6 | 10 | |
| Mathematical Reasoning | MathVision Mini | Score37.5 | 9 | |
| Mathematical Reasoning | MathVision mini (test) | Accuracy0.276 | 8 | |
| Mathematical Reasoning | MathVision (out-of-distribution) | Accuracy27.93 | 6 | |
| First Incorrect Step Identification | MathVision | FISI F1 Score26.2 | 6 | |
| Visual Question Answering | MathVision full (test) | Accuracy43.6 | 4 | |
| Multimodal Mathematical Reasoning | MathVision mini (test) | Accuracy29.6 | 2 |
Showing 17 of 17 rows