gsm
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | GSM-Hard | Accuracy99 | 169 | |
| Mathematical Reasoning | GSM-Hard | Solve Rate78 | 162 | |
| Mathematical Reasoning | GSM | Accuracy92.5 | 35 | |
| Math Reasoning | GSM Hard | Accuracy66.9 | 31 | |
| Mathematical Reasoning | GSM-Hard | GSM-Hard pass@1 Acc69.6 | 27 | |
| Mathematical Reasoning | GSM | Accuracy61 | 27 | |
| Mathematical Reasoning (Calculator) | GSM-PLUS | Accuracy76.54 | 25 | |
| Mathematical Reasoning | GSM-ICM | Accuracy92.7 | 16 | |
| Math Reasoning | GSM-H (held-out) | Accuracy (%)57.54 | 14 | |
| Math | GSM-Plus | Score89.74 | 10 | |
| Grade-school reasoning | GSM Hard | Pass@1 Success Rate53.4 | 9 | |
| Correctness verification | GSM-Symbolic | LB0.435 | 8 | |
| Mathematical Reasoning | GSM | GSM Accuracy92.16 | 7 | |
| Arithmetic Reasoning | GSM Reversed | Accuracy90.3 | 7 | |
| Mathematical Reasoning | GSM-SYS | Accuracy80.9 | 7 | |
| Compiler phase ordering | gsm | Execution Cycles6,178 | 7 | |
| Math Reasoning | GSM MC | FPR3.75 | 5 | |
| Mathematical Reasoning | GSM Hard | Accuracy24.6 | 5 | |
| Arithmetic Reasoning | GSM | Accuracy72.7 | 4 | |
| Mathematical Reasoning | GSM | Win Rate48.9 | 1 | |
| Failure Flipping | GSMPlus | Trial Success Rate0.49 | 1 |
Showing 21 of 21 rows