gsm
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | GSM-Hard | Accuracy99 | 169 | |
| Mathematical Reasoning | GSM-Hard | Solve Rate78 | 162 | |
| Math Reasoning | GSM Hard | Accuracy82.6 | 73 | |
| Reasoning | GSM PRO | Accuracy100 | 72 | |
| Mathematical Reasoning | GSM | Accuracy94 | 70 | |
| Mathematical Reasoning | GSM-Hard | Accuracy89.52 | 46 | |
| Reasoning | GSM→FOL | Accuracy85.8 | 45 | |
| Mathematical Reasoning | GSM-sym | Exact Match90.22 | 44 | |
| Mathematical Reasoning | GSM (test) | Accuracy65.4 | 42 | |
| Mathematical Reasoning | GSM-Hard | GSM-Hard pass@1 Acc69.6 | 40 | |
| Mathematical Reasoning | GSM Hard | Accuracy68.6 | 31 | |
| Math | GSM-Plus | Score90.7 | 28 | |
| Mathematical Reasoning | GSM | GSM Accuracy92.16 | 27 | |
| Mathematical Reasoning | GSM | Accuracy61 | 27 | |
| Mathematical Reasoning (Calculator) | GSM-PLUS | Accuracy76.54 | 25 | |
| Mathematical Reasoning | GSM-ICM | Accuracy92.7 | 16 | |
| Mathematical Reasoning | GSM Hard | Accuracy10.8 | 15 | |
| Math Reasoning | GSM-H (held-out) | Accuracy (%)57.54 | 14 | |
| Mathematical Reasoning | GSM | Pass@1 Accuracy82.18 | 13 | |
| Mathematical Reasoning | GSM 8K | pass@K97.77 | 12 | |
| Multi-objective reinforcement learning | RLVR-GSM | Multiplicative Gap (ε)0.0112 | 12 | |
| Mathematical Reasoning | GSM8K | Accuracy97.8 | 9 | |
| Mathematical Reasoning | GSM Hard | Accuracy52.69 | 9 | |
| Grade-school reasoning | GSM Hard | Pass@1 Success Rate53.4 | 9 | |
| Correctness verification | GSM-Symbolic | LB0.435 | 8 |
Showing 25 of 39 rows