GSM8K
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | GSM8K | Accuracy97.1 | 1,424 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy99 | 954 | |
| Mathematical Reasoning | GSM8K (test) | Accuracy98.8 | 816 | |
| Mathematical Reasoning | GSM8K | Accuracy98 | 499 | |
| Mathematical Reasoning | GSM8k | Accuracy100 | 388 | |
| Mathematical Reasoning | GSM8K | Accuracy (GSM8K)97.8 | 358 | |
| Mathematical Reasoning | GSM8K | Accuracy (Acc)96.81 | 352 | |
| Math Reasoning | GSM8K (test) | Accuracy95.9 | 276 | |
| Arithmetic Reasoning | GSM8K | Accuracy97.1 | 272 | |
| Math reasoning | GSM8K | Accuracy98.87 | 254 | |
| Math | GSM8K | Accuracy0.988 | 248 | |
| Mathematical Reasoning | GSM8K | Speed Up (x)13.4 | 246 | |
| Mathematical Reasoning | GSM8K | GSM8K Accuracy (%)95.38 | 220 | |
| Performance Estimation | GSM8K | MAE0 | 204 | |
| Arithmetic Reasoning | GSM8K (test) | Accuracy97.35 | 203 | |
| Mathematical Reasoning | GSM8K | Math Score96.4 | 197 | |
| Mathematical Reasoning | GSM8K | Accuracy97.54 | 192 | |
| Math Reasoning | GSM8K | Accuracy (GSM8K)100 | 190 | |
| Grade School Math Reasoning | GSM8K | Accuracy (GSM8K)98 | 186 | |
| Mathematical Reasoning | GSM8K | Accuracy97 | 166 | |
| Math Word Problem Solving | GSM8K | Accuracy95.3 | 158 | |
| Hallucination Detection | GSM8K | AUROC90.37 | 131 | |
| Mathematical Reasoning | GSM8K | Accuracy84 | 130 | |
| Math Reasoning | GSM8K | Accuracy93.8 | 126 | |
| Mathematical Reasoning | GSM8K | EM97.04 | 123 |
Showing 25 of 899 rows
...