MATH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MATH500 (test) | Accuracy97.3 | 895 | |
| Mathematical Reasoning | MATH | Accuracy95.63 | 882 | |
| Mathematical Reasoning | MATH 500 | Accuracy (Acc)99.1 | 543 | |
| Mathematical Reasoning | MATH | Accuracy94.2 | 535 | |
| Mathematical Reasoning | MATH 500 | Accuracy98.4 | 442 | |
| Mathematical Reasoning | MATH (test) | Overall Accuracy94.13 | 433 | |
| Mathematical Reasoning | MATH 500 | Top-1 Accuracy95 | 384 | |
| Mathematical Reasoning | MATH | Accuracy96.67 | 338 | |
| Mathematical Reasoning | MATH 500 | pass@197.3 | 239 | |
| Mathematical Reasoning | MATH 500 | Pass@1 Rate96 | 236 | |
| Mathematical Problem Solving | MATH | Accuracy97.6 | 229 | |
| Mathematical Reasoning | MATH 500 | Accuracy95.6 | 221 | |
| Mathematical Reasoning | MATH Hard | Accuracy92.8 | 198 | |
| Math Reasoning | MATH | Accuracy90.54 | 160 | |
| Mathematical Reasoning | MATH (test) | Pass@194.8 | 151 | |
| Mathematics | MATH | MATH Accuracy95.1 | 136 | |
| Mathematical Reasoning | Math500 | Accuracy (ACC)88.2 | 133 | |
| Mathematics | MATH 500 | Pass@197.3 | 122 | |
| Math | MATH-500 | Accuracy99.2 | 120 | |
| Mathematical Reasoning | MATH-500 | Accuracy97.6 | 119 | |
| Mathematical Reasoning | MATH 500 | Accuracy97.75 | 116 | |
| Mathematical Reasoning | MATH | Pass@192.71 | 112 | |
| Mathematical Reasoning | MATH500 (full) | Accuracy92.4 | 111 | |
| Mathematical Reasoning | MATH 500 | MATH 500 Accuracy97.9 | 106 | |
| Reasoning | MATH 500 | Accuracy (%)100 | 94 |
Showing 25 of 848 rows
...