DynaMath
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | DynaMath | Accuracy81.42 | 146 | |
| Multimodal Reasoning | DynaMath | Accuracy67.2 | 77 | |
| Multimodal Mathematical Reasoning | DynaMath | Accuracy (DynaMath)69.2 | 45 | |
| Visual Mathematical Reasoning | DynaMath | Accuracy81.42 | 45 | |
| Multimodal Mathematical Reasoning | DynaMath | DynaMath Score66.4 | 31 | |
| Visual Reasoning | DynaMath | Accuracy66.48 | 26 | |
| Mathematical Reasoning | DynaMath | Pass@183.3 | 25 | |
| Mathematical Reasoning | DynaMath DMath | Accuracy56.9 | 18 | |
| Step-wise Verification | DynaMath | Macro F166.7 | 18 | |
| Visual Mathematical Reasoning | DynaMath | Worst-case Accuracy35.73 | 17 | |
| Visual Mathematical Reasoning | DynaMath worst | Score34.9 | 16 | |
| Mathematical & Geometric Reasoning | DynaMath | Accuracy@873.1 | 16 | |
| Dynamic mathematical reasoning | DynaMath (test) | Accuracy64.8 | 15 | |
| Multimodal Mathematical Reasoning | DynaMath-W | Accuracy60.5 | 14 | |
| Multimodal Mathematical Reasoning | DynaMath worst case | Accuracy37.7 | 13 | |
| Mathematical Vision Understanding | DynaMath | Accuracy66.43 | 12 | |
| Math Reasoning | DynaMath | Worst Case Accuracy (WCA)26.8 | 11 | |
| STEM & Puzzle | DynaMath (test) | Accuracy83.4 | 11 | |
| Mathematical Reasoning | DynaMath | Avg@358.7 | 10 | |
| Math | DynaMath | Pass@170.5 | 7 | |
| Visual Math Reasoning | DynaMath | Pass@179 | 6 | |
| Multimodal Math Reasoning | DynaMath Reasoning | Average Score (DynaMath)65.3 | 6 | |
| Math & Reasoning | DynaMath worst | Score41.3 | 6 | |
| First Incorrect Step Identification | DynaMath | FISI F1 Score26.7 | 6 |
Showing 24 of 24 rows