Language Understanding on MMLU-Redux
85.75Accuracy
Instruct Model (Q1)
Updated 16d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.01 | 85.75 | 0.1177 | 0.1071 | -0.7399 | |
2026.01 | 85.75 | 0.1101 | 0.0612 | -0.7474 | |
2026.05 | 85.7 | - | - | - | |
2026.02 | 83.92 | - | - | - | |
2026.02 | 83.16 | - | - | - | |
2026.01 | 81.12 | 0.1084 | 0.0152 | -0.7028 | |
2026.05 | 80.6 | - | - | - | |
2026.01 | 80.26 | 0.1653 | 0.161 | -0.6373 | |
2026.01 | 80.26 | 0.1498 | 0.0965 | -0.6528 | |
2026.05 | 79.5 | - | - | - | |
2026.02 | 79.28 | - | - | - | |
2026.02 | 78.23 | - | - | - | |
2026.05 | 77.3 | - | - | - | |
2026.01 | 73.54 | 0.1379 | 0.0279 | -0.5976 | |
2026.01 | 70.44 | 0.232 | 0.2097 | -0.4724 | |
2026.01 | 70.26 | 0.2475 | 0.2461 | -0.4552 | |
2026.05 | 70.2 | - | - | - | |
2026.05 | 66 | - | - | - | |
2026.01 | 64.46 | 0.1714 | 0.019 | -0.4732 | |
2026.01 | 54.58 | 0.3762 | 0.3742 | -0.1696 | |
2026.01 | 54.58 | 0.3571 | 0.3485 | -0.1887 | |
2026.01 | 53.16 | 0.2005 | 0.0277 | -0.331 | |
2026.05 | 50 | - | - | - | |
2026.05 | 45.3 | - | - | - | |
2026.05 | 43.6 | - | - | - | |
2026.05 | 43.6 | - | - | - | |
2026.05 | 42.6 | - | - | - | |
2026.05 | 41 | - | - | - | |
2026.05 | 8.1 | - | - | - | |
2026.01 | - | 0.2356 | 0.0546 | -0.3102 | |
2026.01 | - | 0.2365 | 0.0184 | -0.3093 | |
2026.01 | - | 0.2294 | 0.0178 | -0.3164 | |
2026.01 | - | 0.1744 | 0.0591 | -0.5282 | |
2026.01 | - | 0.1879 | 0.0389 | -0.5147 | |
2026.01 | - | 0.1696 | 0.0331 | -0.533 | |
2026.01 | - | 0.1299 | 0.0563 | -0.6727 | |
2026.01 | - | 0.1403 | 0.0287 | -0.6623 | |
2026.01 | - | 0.1239 | 0.0117 | -0.6788 | |
2026.01 | - | 0.1011 | 0.0679 | -0.7565 | |
2026.01 | - | 0.1086 | 0.0303 | -0.749 | |
2026.01 | - | 0.0986 | 0.0411 | -0.7589 |