MathVision
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Mathematical Reasoning | MathVision | Accuracy92.7 | 186 | |
| Multimodal Math Reasoning | MathVision | Accuracy86 | 183 | |
| Mathematical Reasoning | MathVision | Accuracy75.95 | 144 | |
| Multimodal reasoning | MathVision | Accuracy57.9 | 102 | |
| Mathematical reasoning | MathVision (test) | Accuracy71.9 | 53 | |
| Multimodal mathematical reasoning | MathVision (test) | Accuracy60.3 | 47 | |
| Multi-modal Reasoning | MathVision (test) | Accuracy (%)47.7 | 45 | |
| Mathematical Visual Question Answering | MathVision | Accuracy73.3 | 34 | |
| Mathematical Reasoning | MathVision Mini | Score47.36 | 25 | |
| STEM Reasoning | MathVision | Accuracy69.96 | 23 | |
| Mathematical Reasoning | MathVision | AUC (%)95.68 | 21 | |
| Mathematical Reasoning | MathVision MVisionm | Accuracy41.3 | 18 | |
| Step-wise Verification | MathVision | Macro F161.7 | 18 | |
| Multimodal Mathematical Reasoning | MathVision | Mean@579.5 | 16 | |
| Visual Mathematical Reasoning | MathVision (test) | Score51.8 | 16 | |
| Mathematics Reasoning | MathVision mini | Accuracy60.54 | 15 | |
| Mathematical Reasoning | MathVision (testmini) | Accuracy29.9 | 13 | |
| Visual Mathematical Reasoning | MathVision | BoN@8 Accuracy43.6 | 12 | |
| Mathematical Reasoning | MathVision | Score63.5 | 11 | |
| Multimodal mathematical reasoning | MathVision | Pass@1 Accuracy58.75 | 11 | |
| CoT Length Prediction | MathVision m | rMAE0.2934 | 10 | |
| Fuel level estimation | MathVision m | rMAE11.86 | 10 | |
| General Perception and Reasoning | MathVision | Score58.6 | 10 | |
| Mathematical Reasoning | MathVision | Top-1 Accuracy72 | 9 | |
| Visual Math Reasoning | MathVision | Score72 | 9 |
Showing 25 of 37 rows