GSM8K
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | GSM8K | Accuracy97.1 | 1,398 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy99 | 954 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy98.8 | 816 | |
| Mathematical Reasoning | GSM8K | Accuracy98 | 499 | |
| Mathematical Reasoning | GSM8k | Accuracy100 | 388 | |
| Mathematical Reasoning | GSM8K | Accuracy (GSM8K)97.8 | 358 | |
| Mathematical Reasoning | GSM8K | Accuracy (Acc)96.81 | 337 | |
| Arithmetic Reasoning | GSM8K | Accuracy97.1 | 272 | |
| Math reasoning | GSM8K | Accuracy98.87 | 254 | |
| Math Reasoning | GSM8K (test) | Accuracy95.9 | 250 | |
| Mathematical Reasoning | GSM8K | Speed Up (x)13.4 | 246 | |
| Math | GSM8K | Accuracy0.988 | 216 | |
| Mathematical Reasoning | GSM8K | GSM8K Accuracy (%)95.38 | 204 | |
| Performance Estimation | GSM8K | MAE0 | 197 | |
| Mathematical Reasoning | GSM8K | Math Score96.4 | 197 | |
| Arithmetic Reasoning | GSM8K (test) | Accuracy97.35 | 189 | |
| Math Word Problem Solving | GSM8K | Accuracy95.3 | 158 | |
| Grade School Math Reasoning | GSM8K | Accuracy (GSM8K)95.6 | 138 | |
| Math Reasoning | GSM8K | Accuracy (GSM8K)100 | 131 | |
| Mathematical Reasoning | GSM8K | Accuracy84 | 130 | |
| Math Reasoning | GSM8K | Accuracy93.8 | 126 | |
| Mathematical Reasoning | GSM8K | EM97.04 | 123 | |
| Mathematical Reasoning | GSM8K v1 (test) | Accuracy95.1 | 118 | |
| Hallucination Detection | GSM8K | AUROC90.37 | 115 | |
| Reasoning | GSM8K | Accuracy1 | 111 |
Showing 25 of 762 rows
...