Multilingual Language Understanding on MMMLU (Language Specific Averages)
60.5Accuracy (Korean)
Task Arithmetic
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.01 | 60.5 | 22 | 37.2 | 39.9 | |
2026.01 | 60.3 | 17.4 | 37.4 | 38.4 | |
2026.01 | 60.3 | 24.2 | 37 | 40.5 | |
2026.01 | 60.3 | 22.6 | 37 | 40 | |
2026.01 | 60 | 25.3 | 36.6 | 40.6 | |
2026.01 | 60 | 24.5 | 37.7 | 40.7 | |
2026.01 | 59.9 | 24.4 | 37.5 | 40.6 | |
2026.01 | 59.8 | 19 | 37.3 | 38.7 | |
2026.01 | 59.7 | 25.1 | 37.2 | 40.7 | |
2026.01 | 59.6 | 20.3 | 37.3 | 39.1 | |
2026.01 | 44.5 | 28.9 | 38.6 | 37.3 | |
2026.01 | 44.4 | 26.1 | 37.6 | 36 | |
2026.01 | 43.6 | 25.3 | 37.3 | 35.4 | |
2026.01 | 43.6 | 27.5 | 37.4 | 36.2 | |
2026.01 | 43.5 | 26.1 | 37.5 | 35.7 | |
2026.01 | 43.4 | 24.6 | 37.5 | 35.2 | |
2026.01 | 43.3 | 24.8 | 37.2 | 35.1 | |
2026.01 | 43.1 | 24.7 | 38.2 | 35.3 | |
2026.01 | 42.9 | 27.6 | 37.5 | 36 | |
2026.01 | 42.8 | 24.3 | 36.7 | 34.6 |