Language Understanding on MMLU-Pro (test) by Model Size
23.6MMLU-Pro (test) Accuracy
Model Swarm
Updated 5d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.05 | 23.6 | - | - | - | - | - | - | |
2026.05 | 23.4 | - | - | - | - | - | - | |
2026.05 | 23.3 | - | - | - | - | - | - | |
2026.05 | 23.2 | - | - | - | - | - | - | |
2026.05 | 23.2 | - | - | - | - | - | - | |
2026.05 | 22.5 | - | - | - | - | - | - | |
2026.05 | 22.4 | - | - | - | - | - | - | |
2026.05 | 22.1 | - | - | - | - | - | - | |
2026.05 | 21.7 | - | - | - | - | - | - | |
2026.05 | 20.7 | - | - | - | - | - | - | |
2026.05 | 20.7 | - | - | - | - | - | - | |
2026.05 | - | 27.5 | 44.4 | 61 | 65.3 | 68.6 | 53.4 | |
2026.05 | - | 24.4 | 36.8 | 51.6 | 55.2 | 60.4 | 45.7 | |
2026.05 | - | 24.9 | 40 | 55.4 | 60.4 | 65.3 | 49.2 | |
2026.05 | - | 24.7 | 38.5 | 54.7 | 59.6 | 66.5 | 48.8 | |
2026.05 | - | 26.2 | 41.1 | 57.3 | 62.4 | 65.6 | 50.5 | |
2026.05 | - | 26.5 | 41.8 | 58.1 | 62.9 | 66.4 | 51.1 | |
2026.05 | - | 26.8 | 41.7 | 58.2 | 61.9 | 66.6 | 51 | |
2026.05 | - | 27.1 | 43.5 | 59.4 | 63.7 | 67.8 | 52.3 |