MGSM
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | MGSM | Accuracy93.2 | 236 | |
| Multilingual Mathematical Reasoning | MGSM (test) | Accuracy93.4 | 109 | |
| Mathematical Reasoning | MGSM (test) | Accuracy (ZH)88 | 80 | |
| Multilingual Mathematical Reasoning | MGSM | Accuracy94.9 | 52 | |
| Question Answering | MGSM | AUC90.79 | 51 | |
| Mathematical Reasoning | MGSM | Accuracy (Bn)88.8 | 49 | |
| Hallucination Detection | MGSM | AUC84.62 | 42 | |
| Multilingual Mathematical Reasoning | MGSM 1.0 (test) | Accuracy (ru)69.6 | 35 | |
| Reasoning | MGSM | Accuracy94.4 | 29 | |
| Multilingual Mathematical Reasoning | MGSM Thai (test) | Accuracy41.6 | 25 | |
| Multilingual Math Reasoning | MGSM | Mean@384.43 | 23 | |
| Math reasoning | mGSM v2 | Accuracy (Seen)78 | 21 | |
| Multilingual mathematical reasoning | MGSM | Speedup (de)6.08 | 20 | |
| Mathematical Reasoning | MGSM Rev2 | Random Baseline Score74.8 | 16 | |
| Mathematical Reasoning | MGSM non-EU languages (test) | Accuracy91.4 | 16 | |
| Mathematical Reasoning | MGSM 24 official EU languages | Accuracy93 | 14 | |
| Mathematical Reasoning | MGSM Bangla | Accuracy (Original)0.88 | 13 | |
| Mathematical Reasoning | MGSM | Average@1044 | 12 | |
| Mathematical Reasoning | MGSM ALL 1.0 (test) | Accuracy75.93 | 12 | |
| Mathematical Reasoning | MGSM EN 1.0 (test) | Accuracy94 | 12 | |
| Machine Translation | MGSM | Bn Score72.89 | 12 | |
| Mathematical Reasoning | Bn-MGSM (test) | Accuracy89.2 | 12 | |
| Mathematical Reasoning | MGSM average (test) | Accuracy84.8 | 12 | |
| Mathematical Reasoning | MGSM-zh (test) | Accuracy89.6 | 12 | |
| Natural Language Understanding | MGSM | Accuracy6.2 | 11 |
Showing 25 of 40 rows