Multi-task Language Understanding on MMLU Pro (test)
65.1History Score
NExt
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2026.04 | 65.1 | 32.1 | 84.7 | 47.9 | 69.8 | 71.1 | 67 | 62.5 | |
2026.04 | 64.2 | 32.3 | 83.1 | 44.2 | 64.7 | 72.4 | 64.9 | 60.8 | |
2026.04 | 63.6 | 33.3 | 83.8 | 47.7 | 69.3 | 71.5 | 68.8 | 62.6 | |
2026.04 | 62.8 | 32.1 | 85.2 | 45.1 | 67.5 | 73.6 | 66.9 | 61.9 | |
2026.04 | 61.1 | 35.2 | 83.4 | 49.1 | 69.8 | 71 | 65.4 | 62.1 | |
2026.04 | 51.1 | 31.3 | 70.6 | 41 | 58.7 | 64.2 | 53.9 | 53 | |
2026.04 | 49.4 | 31.1 | 70.7 | 41 | 59.4 | 61.6 | 54.4 | 52.5 | |
2026.04 | 48.3 | 32.4 | 71.5 | 41.5 | 59.2 | 63.9 | 55.4 | 53.2 | |
2026.04 | 47.4 | 31.8 | 70 | 39.5 | 58.7 | 61.8 | 54.4 | 51.9 | |
2026.04 | 46.6 | 31 | 70.3 | 36.3 | 53.6 | 61.3 | 52.2 | 50.2 | |
2026.04 | 36.9 | 18.5 | 59.9 | 35.5 | 41.2 | 54.2 | 35.6 | 40.3 | |
2026.04 | 35.3 | 20.3 | 60.8 | 35.8 | 40.2 | 54.2 | 36.5 | 40.4 | |
2026.04 | 34.1 | 20.5 | 60.6 | 35.5 | 41.7 | 54.2 | 36.8 | 40.5 | |
2026.04 | 32.4 | 18.3 | 55 | 35.7 | 36 | 51.9 | 37.5 | 38.1 | |
2026.04 | 32.4 | 19.6 | 60.8 | 33 | 41.9 | 52.8 | 37.9 | 39.8 | |
2026.04 | 19.3 | 16.5 | 38.7 | 16.9 | 20.7 | 38.8 | 27.2 | 25.4 | |
2026.04 | 18.8 | 19.4 | 44.7 | 19.8 | 21.2 | 39.8 | 26.4 | 27.2 | |
2026.04 | 17.6 | 18.3 | 45.2 | 20.9 | 22 | 41.1 | 26.1 | 27.3 | |
2026.04 | 16.2 | 8.5 | 29.1 | 14.5 | 16.1 | 21.7 | 18 | 17.7 | |
2026.04 | 16.1 | 17 | 40.6 | 20.9 | 18 | 40.3 | 26.7 | 25.7 |