MultiArith
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Arithmetic Reasoning | MultiArith | Accuracy100 | 181 | |
| Mathematical Reasoning | MultiArith | Accuracy100 | 116 | |
| Arithmetic Reasoning | MultiArith (test) | Accuracy99.3 | 67 | |
| Mathematical reasoning | MultiArith Out of Distribution | Top-1 Accuracy (Maj@1)100 | 30 | |
| Math Reasoning | MultiArith | Accuracy98.3 | 14 | |
| Follow-up Questioning Consistency | MultiArith (unseen) | Average Success Count18.33 | 12 | |
| Arithmetic Reasoning | MultiArith | Accuracy (format-specific prompt)78.7 | 2 |
Showing 7 of 7 rows