Multilingual Language Understanding on MMMLU (Language Specific Averages)
60.5Accuracy (Korean)
Task Arithmetic
Updated 18d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.01 | 60.5 | 22 | 37.2 | 39.9 | - | |
2026.01 | 60.3 | 17.4 | 37.4 | 38.4 | - | |
2026.01 | 60.3 | 24.2 | 37 | 40.5 | - | |
2026.01 | 60.3 | 22.6 | 37 | 40 | - | |
2026.01 | 60 | 25.3 | 36.6 | 40.6 | - | |
2026.01 | 60 | 24.5 | 37.7 | 40.7 | - | |
2026.01 | 59.9 | 24.4 | 37.5 | 40.6 | - | |
2026.01 | 59.8 | 19 | 37.3 | 38.7 | - | |
2026.01 | 59.7 | 25.1 | 37.2 | 40.7 | - | |
2026.01 | 59.6 | 20.3 | 37.3 | 39.1 | - | |
2026.01 | 44.5 | 28.9 | 38.6 | 37.3 | - | |
2026.01 | 44.4 | 26.1 | 37.6 | 36 | - | |
2026.01 | 43.6 | 25.3 | 37.3 | 35.4 | - | |
2026.01 | 43.6 | 27.5 | 37.4 | 36.2 | - | |
2026.01 | 43.5 | 26.1 | 37.5 | 35.7 | - | |
2026.01 | 43.4 | 24.6 | 37.5 | 35.2 | - | |
2026.01 | 43.3 | 24.8 | 37.2 | 35.1 | - | |
2026.01 | 43.1 | 24.7 | 38.2 | 35.3 | - | |
2026.01 | 42.9 | 27.6 | 37.5 | 36 | - | |
2026.01 | 42.8 | 24.3 | 36.7 | 34.6 | - | |
2026.07 | - | - | - | - | 88.4 | |
2026.07 | - | - | - | - | 86.3 | |
2026.07 | - | - | - | - | 83.4 | |
2026.07 | - | - | - | - | 76.6 | |
2026.07 | - | - | - | - | 67.4 | |
2026.07 | - | - | - | - | 70.7 |