MathVision
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Mathematical Reasoning | MathVision | Accuracy92.7 | 298 | |
| Multimodal Math Reasoning | MathVision | Accuracy86 | 263 | |
| Mathematical Reasoning | MathVision | Accuracy75.95 | 168 | |
| Multimodal reasoning | MathVision | Accuracy59.41 | 162 | |
| Mathematical Reasoning | MathVision | Accuracy83.9 | 89 | |
| Mathematical reasoning | MathVision (test) | Accuracy71.9 | 53 | |
| Multimodal mathematical reasoning | MathVision (test) | Accuracy60.3 | 47 | |
| Multi-modal Reasoning | MathVision (test) | Accuracy (%)47.7 | 45 | |
| Mathematical Reasoning | MathVision mini (test) | Accuracy52 | 44 | |
| Mathematics Reasoning | MathVision mini | Accuracy60.54 | 35 | |
| Mathematical Visual Question Answering | MathVision | Accuracy73.3 | 34 | |
| Mathematical Reasoning | MathVision Mini | Score47.36 | 32 | |
| Multimodal mathematical reasoning | MathVision | Pass@1 Accuracy61.5 | 31 | |
| Image Reasoning | MathVision mini | Accuracy52.63 | 27 | |
| Mathematical Reasoning | MathVision | Top-1 Accuracy72 | 27 | |
| Multimodal Reasoning | MathVision | Mean@8 Accuracy51.36 | 26 | |
| Visual mathematical reasoning | MathVision mini | Accuracy60.5 | 26 | |
| Visual Math Reasoning | MathVision | Score72 | 24 | |
| STEM Reasoning | MathVision | Accuracy69.96 | 23 | |
| Image Reasoning | MathVision | Accuracy57.88 | 22 | |
| Mathematical Reasoning | MathVision | AUC (%)95.68 | 21 | |
| Math Reasoning | MathVision | Accuracy72 | 20 | |
| Multimodal Reasoning | MathVision | FEI46.07 | 20 | |
| Mathematical Reasoning | MathVision MVisionm | Accuracy41.3 | 18 | |
| Step-wise Verification | MathVision | Macro F161.7 | 18 |
Showing 25 of 64 rows