Multilingual Language Understanding on M-MMLU (test)
65.2zh Accuracy
REFLECT
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2025.05 | 65.2 | 60.3 | 57 | 57.8 | 45.5 | 45 | 48 | 45.7 | 53.1 | |
2025.05 | 64.6 | 44.2 | 69.5 | 66.2 | 26.9 | 38.8 | 30.4 | 47.3 | 48.5 | |
2025.05 | 61.2 | 58.9 | 57.6 | 52.3 | 49.6 | 58.1 | 58.1 | 55.8 | 56.5 | |
2025.05 | 57.4 | 47.4 | 53.6 | 53.2 | 45.5 | 48 | 58 | 54.2 | 52.2 | |
2025.05 | 57.4 | 64.7 | 60.9 | 58.4 | 48.2 | 44.1 | 50.6 | 53.1 | 54.7 | |
2025.05 | 56.8 | 52.6 | 45.7 | 43.5 | 47.6 | 50.4 | 52.7 | 52.7 | 51.4 | |
2025.05 | 53.6 | 50.6 | 49 | 47.4 | 49.7 | 38 | 51.4 | 47.3 | 48.4 | |
2025.05 | 51.6 | 60.8 | 58.9 | 58.4 | 44.1 | 41 | 44.5 | 50 | 51.2 | |
2025.05 | 51 | 53.2 | 53.6 | 49.4 | 42.1 | 52.7 | 51.4 | 43.4 | 49.6 | |
2025.05 | 49.7 | 53.2 | 47.7 | 48.1 | 47.6 | 46.6 | 46 | 44.2 | 47.9 | |
2025.05 | 49.7 | 53.2 | 56.3 | 45.5 | 49.7 | 44.2 | 58.1 | 54.3 | 51.4 | |
2025.05 | 48.4 | 46.8 | 54.3 | 48.7 | 40.7 | 54.3 | 60.1 | 50.4 | 50.5 | |
2025.05 | 41.9 | 51.9 | 57 | 54.6 | 53.1 | 50.4 | 48 | 52.7 | 51.2 | |
2025.05 | 38.1 | 42.3 | 49 | 43.5 | 44.2 | 44.2 | 51.4 | 46.7 | 44.9 |