Language Understanding on MMLU (o=1 Exact Split)
77.6Accuracy
ITD
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 77.6 | 0.106 | |
2026.01 | 77.5 | 0.105 | |
2026.01 | 74.2 | 0.072 | |
2026.01 | 74.2 | 0.069 | |
2026.01 | 73.5 | 0.062 | |
2026.01 | 73.4 | 0.159 | |
2026.01 | 73 | 0.057 | |
2026.01 | 72.7 | 0.151 | |
2026.01 | 72.1 | 0.145 | |
2026.01 | 71 | 0.16 | |
2026.01 | 70.5 | 0.035 | |
2026.01 | 69.5 | 0.12 | |
2026.01 | 67.3 | - | |
2026.01 | 67 | - | |
2026.01 | 66.3 | 0.114 | |
2026.01 | 63.1 | 0.18 | |
2026.01 | 62 | 0.07 | |
2026.01 | 61.9 | 0.051 | |
2026.01 | 61.9 | 0.054 | |
2026.01 | 61.7 | 0.166 | |
2026.01 | 61.6 | 0.04 | |
2026.01 | 61 | 0.159 | |
2026.01 | 61 | 0.063 | |
2026.01 | 59.4 | 0.188 | |
2026.01 | 57.6 | - | |
2026.01 | 57.6 | 0.027 | |
2026.01 | 54.9 | - | |
2026.01 | 54.7 | 0.029 | |
2026.01 | 51.5 | 0.034 | |
2026.01 | 49.9 | 0.093 | |
2026.01 | 49.2 | 0.086 | |
2026.01 | 48.4 | 0.065 | |
2026.01 | 47.8 | 0.027 | |
2026.01 | 47 | 0.064 | |
2026.01 | 45.1 | - | |
2026.01 | 40.6 | - | |
2026.01 | 40.4 | 0.047 | |
2026.01 | 39.5 | 0.275 | |
2026.01 | 38.9 | 0.284 | |
2026.01 | 36.3 | 0.043 | |
2026.01 | 30 | 0.151 | |
2026.01 | 26.3 | 0.143 |