| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | GSM8K | Accuracy97.1 | 1,362 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy99 | 900 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy97.72 | 770 | |
| Mathematical Reasoning | GSM8K | Accuracy98 | 499 | |
| Mathematical Reasoning | GSM8K | Accuracy (GSM8K)97.8 | 358 | |
| Mathematical Reasoning | GSM8k | Accuracy96.21 | 312 | |
| Mathematical Reasoning | GSM8K | Speed Up (x)13.4 | 246 | |
| Math | GSM8K | Accuracy0.988 | 206 | |
| Mathematical Reasoning | GSM8K | Math Score96.4 | 197 | |
| Math Reasoning | GSM8K (test) | Accuracy94.5 | 192 | |
| Math reasoning | GSM8K | Accuracy95.15 | 187 | |
| Arithmetic Reasoning | GSM8K | Accuracy97.1 | 173 | |
| Arithmetic Reasoning | GSM8K (test) | Accuracy97.35 | 129 | |
| Math Reasoning | GSM8K | Accuracy93.8 | 126 | |
| Mathematical Reasoning | GSM8K | EM97.04 | 123 | |
| Math Word Problem Solving | GSM8K | Accuracy96.8 | 111 | |
| Reasoning | GSM8K | Accuracy1 | 106 | |
| Mathematical Reasoning | GSM8K | pass@196.7 | 102 | |
| Mathematical reasoning | GSM8K | Tau ($ au$)6.92 | 97 | |
| Hallucination Detection | GSM8K | AUROC90.37 | 93 | |
| Math Word Problem Solving | GSM8K | Accuracy95.3 | 87 | |
| Mathematical Reasoning | GSM8K (val) | Accuracy90.8 | 81 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy89.2 | 79 | |
| Grade School Math Reasoning | GSM8K | Accuracy (GSM8K)95.1 | 77 | |
| Mathematical Reasoning | GSM8K | Accuracy93 | 66 |