MATH
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MATH | Accuracy95.63 | 643 | |
| Mathematical Reasoning | MATH | Accuracy94.2 | 535 | |
| Mathematical Reasoning | MATH (test) | Overall Accuracy94.13 | 433 | |
| Mathematical Reasoning | MATH500 (test) | Accuracy97.3 | 381 | |
| Mathematical Problem Solving | MATH | Accuracy97.6 | 166 | |
| Mathematical Reasoning | MATH | Accuracy96.67 | 162 | |
| Mathematical Reasoning | MATH 500 | Accuracy92 | 155 | |
| Mathematical Reasoning | MATH 500 | pass@196.9 | 153 | |
| Mathematical Reasoning | MATH (test) | Pass@194.8 | 151 | |
| Mathematical Reasoning | Math500 | Accuracy (ACC)88.2 | 133 | |
| Mathematical Reasoning | MATH-500 | Accuracy97.6 | 119 | |
| Mathematical Reasoning | MATH | Pass@192.71 | 112 | |
| Mathematical Reasoning | MATH500 (full) | Accuracy92.4 | 111 | |
| Mathematical Reasoning | MATH 500 | MATH 500 Accuracy97.9 | 106 | |
| Math Reasoning | MATH | Accuracy75.5 | 88 | |
| Mathematical Reasoning | MATH L5 | Accuracy0.859 | 86 | |
| Mathematical Reasoning | MATH 500 | Accuracy91.2 | 73 | |
| Hallucination Detection | Math | Mean AUROC81.57 | 72 | |
| Reasoning | MATH 500 | Accuracy (%)100 | 59 | |
| Mathematical Reasoning | MATH500 | Accuracy92.1 | 57 | |
| Mathematical Reasoning | MATH | Score96.7 | 50 | |
| Mathematical Reasoning | MATH-500 | Token Savings84.1 | 48 | |
| Mathematical Reasoning | MATH | Accuracy38.36 | 48 | |
| Mathematical Reasoning | MATH500 | Accuracy90 | 45 | |
| Math Reasoning | MATH500 | Accuracy93.2 | 41 |
Showing 25 of 325 rows
...