Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multilingual Grade School Math on MGSM (Language Breakdown and Average)
Loading...
58
Accuracy (Bengali)
SARA
7.248
20.424
33.6
46.776
Jun 24, 2026
Accuracy (Bengali)
Accuracy (Telugu)
Accuracy (Swahili)
Accuracy (English)
Average Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy (Bengali)
Accuracy (Telugu)
Accuracy (Swahili)
Accuracy (English)
Average Accuracy
SARA
Backbone=Phi-3.5-MoE-i...
2026.06
58
46
54
69.2
56.8
ShifCon
Backbone=Phi-3.5-MoE-i...
2026.06
56.4
45.2
53.6
68
55.8
FFT
Backbone=Phi-3.5-MoE-i...
2026.06
54.8
44
55.6
66.4
55.2
AES
Backbone=Phi-3.5-MoE-i...
2026.06
53.2
42.4
52
65.6
53.3
Vanilla LM
Backbone=Phi-3.5-MoE-i...
2026.06
9.2
0
11.2
65.2
21.4
Feedback
Search any
task
Search any
task