MATH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MATH | Accuracy95.63 | 882 | |
| Mathematical Reasoning | MATH | Accuracy94.2 | 535 | |
| Mathematical Reasoning | MATH500 (test) | Accuracy97.3 | 514 | |
| Mathematical Reasoning | MATH 500 | Accuracy98.4 | 442 | |
| Mathematical Reasoning | MATH (test) | Overall Accuracy94.13 | 433 | |
| Mathematical Reasoning | MATH | Accuracy96.67 | 338 | |
| Mathematical Reasoning | MATH 500 | pass@197.3 | 239 | |
| Mathematical Problem Solving | MATH | Accuracy97.6 | 229 | |
| Mathematical Reasoning | MATH (test) | Pass@194.8 | 151 | |
| Mathematical Reasoning | MATH 500 | Accuracy (Acc)97.8 | 149 | |
| Mathematical Reasoning | Math500 | Accuracy (ACC)88.2 | 133 | |
| Math Reasoning | MATH | Accuracy75.5 | 121 | |
| Mathematical Reasoning | MATH-500 | Accuracy97.6 | 119 | |
| Mathematical Reasoning | MATH 500 | Top-1 Accuracy90 | 112 | |
| Mathematical Reasoning | MATH | Pass@192.71 | 112 | |
| Mathematical Reasoning | MATH500 (full) | Accuracy92.4 | 111 | |
| Mathematical Reasoning | MATH 500 | MATH 500 Accuracy97.9 | 106 | |
| Mathematics | MATH 500 | Pass@197.3 | 95 | |
| Mathematical Reasoning | MATH L5 | Accuracy0.859 | 90 | |
| Reasoning | MATH 500 | Accuracy (%)100 | 90 | |
| Math | MATH-500 | Accuracy99.2 | 86 | |
| Mathematics | MATH | MATH Accuracy95.1 | 85 | |
| Mathematical Reasoning | MATH500 | Accuracy96.2 | 82 | |
| Mathematical Reasoning | MATH 500 | Pass@1 Rate88.67 | 76 | |
| Mathematical Reasoning | MATH 500 | Accuracy91.2 | 73 |
Showing 25 of 541 rows
...