Language Understanding on MMLU (Subject Averages)
68.6Humanities Avg
Mixtral-8x22B
Updated 4d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2024.07 | 68.6 | 67.1 | 84.1 | 78.7 | - | |
2025.06 | 64.59 | 81.01 | 82.22 | 77.61 | 74.99 | |
2024.07 | 63.7 | 62.1 | 80 | 75.6 | - | |
2024.07 | 62.3 | 60.2 | 78.5 | 73.4 | - | |
2025.06 | 61.42 | 71.24 | 75.43 | 74.95 | 69.73 | |
2025.06 | 61.11 | 69.52 | 75.76 | 75.35 | 69.41 | |
2024.07 | 60.5 | 58.9 | 77.8 | 74.2 | - | |
2024.07 | 60.4 | 59.5 | 78 | 73 | - | |
2025.06 | 59.49 | 75.08 | 78.55 | 74.43 | 70.47 | |
2024.07 | 58.1 | 54.3 | 72.5 | 68.3 | - | |
2024.07 | 58 | 54.1 | 74.9 | 70.2 | - | |
2024.07 | 57.8 | 51.3 | 69.7 | 64.2 | - | |
2024.07 | 56 | 52.4 | 73.1 | 68.2 | - | |
2024.07 | 54.4 | 51.8 | 70.2 | 66.8 | - | |
2024.07 | 53.9 | 52.3 | 67.2 | 64.2 | - | |
2024.07 | 52.4 | 49 | 66.4 | 63.7 | - | |
2024.07 | 51.8 | 46.9 | 60.5 | 60.5 | - | |
2024.05 | 49.9 | 41.7 | 57.5 | 57 | 51.5 | |
2024.05 | 49.8 | 42.1 | 58.6 | 59.7 | 52.6 | |
2024.07 | 49.2 | 45 | 59.7 | 58.2 | - | |
2024.07 | 48.1 | 45.2 | 58.5 | 55.2 | - | |
2024.07 | 48 | 43.3 | 57 | 54.6 | - | |
2024.05 | 46.1 | 40.8 | 56.6 | 56.2 | 49.9 | |
2024.07 | 45.7 | 42 | 57.7 | 45.7 | - | |
2024.05 | 45.4 | 41.7 | 55.8 | 56 | 49.7 | |
2024.05 | 44.9 | 41.2 | 54.7 | 57.6 | 49.6 | |
2024.07 | 43.5 | 40.4 | 52.7 | 43.5 | - | |
2024.07 | 36.9 | 35.1 | 45.6 | 43.4 | - | |
2024.07 | 27.3 | 24.4 | 25.4 | 27.9 | - | |
2024.07 | 24.8 | 24.7 | 26.5 | 25 | - | |
2024.07 | 22.7 | 24 | 25.8 | 23.4 | - | |
2025.06 | 15.75 | 12.62 | 22.59 | 11.29 | 15.55 | |
2025.06 | 12.55 | 16.29 | 16.83 | 16.09 | 17.3 |