MAWPS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MAWPS | Accuracy98.5 | 279 | |
| Mathematical Reasoning | MAWPS (test) | Accuracy96.5 | 87 | |
| Mathematical Reasoning | MAWPS | Pass@197.8 | 38 | |
| Mathematical Equation Generation | MAWPS (5-fold cross-validation) | Accuracy (5-fold)92.5 | 23 | |
| Arithmetic Reasoning | MAWPS | Accuracy95.94 | 23 | |
| Math Word Problem Solving | MAWPS (5-fold cross-val) | Accuracy92.3 | 21 | |
| Arithmetic Reasoning | MAWPS (test) | Accuracy91.6 | 14 | |
| Math Word Problem solving | MAWPS original (whole dataset) | Value Accuracy91 | 14 | |
| Math Word Problem solving | MAWPS English (test) | Accuracy93 | 10 | |
| Arithmetic Reasoning | MAWPS (5-fold cross val) | Accuracy94.3 | 10 | |
| Math Word Problem Solving | MAWPS | pass@1 Accuracy73.7 | 6 | |
| Mathematical Reasoning | MAWPS Out-of-Distribution (test) | Accuracy96.5 | 5 | |
| Arithmetic Reasoning | MAWPS numeric-remapping attack | Accuracy98.81 | 3 |
Showing 13 of 13 rows