MGSM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MGSM | Accuracy91.7 | 194 | |
| Multilingual Mathematical Reasoning | MGSM (test) | Accuracy93.4 | 57 | |
| Multilingual Mathematical Reasoning | MGSM | Accuracy94.9 | 52 | |
| Mathematical Reasoning | MGSM (test) | Accuracy (MGSM)75.6 | 49 | |
| Multilingual Mathematical Reasoning | MGSM 1.0 (test) | Accuracy (ru)69.6 | 35 | |
| Mathematical Reasoning | MGSM | Accuracy (Bn)75.7 | 30 | |
| Reasoning | MGSM | Accuracy90 | 24 | |
| Multilingual mathematical reasoning | MGSM | Speedup (de)6.08 | 20 | |
| Mathematical Reasoning | MGSM Rev2 | Random Baseline Score74.8 | 16 | |
| Mathematical Reasoning | MGSM non-EU languages (test) | Accuracy91.4 | 16 | |
| Mathematical Reasoning | MGSM 24 official EU languages | Accuracy93 | 14 | |
| Mathematical Reasoning | MGSM Bangla | Accuracy (Original)0.88 | 13 | |
| Machine Translation | MGSM | Bn Score72.89 | 12 | |
| Mathematical Reasoning | Bn-MGSM (test) | Accuracy89.2 | 12 | |
| Mathematical Reasoning | MGSM average (test) | Accuracy84.8 | 12 | |
| Natural Language Understanding | MGSM | Accuracy6.2 | 11 | |
| Multilingual | MGSM | MGSM Score87.47 | 10 | |
| Mathematical Reasoning | MGSM-zh (test) | Accuracy79.6 | 10 | |
| Mathematical Reasoning | MGSM Basque | Accuracy85.2 | 8 | |
| Mathematical Reasoning | MGSM Code Switched P, I - (EN), Q(X) (Avg) | Language Consistency100 | 8 | |
| Mathematical Reasoning | MGSM Monolingual P, I, Q - (X) (Avg) | Language Consistency100 | 8 | |
| STEM | MGSM Zh | Pass@169.7 | 6 | |
| Multilingual Mathematical Reasoning | MGSM 18 languages | Accuracy72.5 | 6 | |
| Mathematical Reasoning | MGSM Thai | Score87.6 | 5 | |
| Mathematical Reasoning | MGSM Māori | Accuracy41.6 | 4 |
Showing 25 of 28 rows