Language Understanding on MMLU-Redux
0.3762Base Score
Instruct Model (Q1)
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.01 | 0.3762 | 54.58 | 0.3742 | -0.1696 | |
2026.01 | 0.3571 | 54.58 | 0.3485 | -0.1887 | |
2026.01 | 0.2475 | 70.26 | 0.2461 | -0.4552 | |
2026.01 | 0.2365 | - | 0.0184 | -0.3093 | |
2026.01 | 0.2356 | - | 0.0546 | -0.3102 | |
2026.01 | 0.232 | 70.44 | 0.2097 | -0.4724 | |
2026.01 | 0.2294 | - | 0.0178 | -0.3164 | |
2026.01 | 0.2005 | 53.16 | 0.0277 | -0.331 | |
2026.01 | 0.1879 | - | 0.0389 | -0.5147 | |
2026.01 | 0.1744 | - | 0.0591 | -0.5282 | |
2026.01 | 0.1714 | 64.46 | 0.019 | -0.4732 | |
2026.01 | 0.1696 | - | 0.0331 | -0.533 | |
2026.01 | 0.1653 | 80.26 | 0.161 | -0.6373 | |
2026.01 | 0.1498 | 80.26 | 0.0965 | -0.6528 | |
2026.01 | 0.1403 | - | 0.0287 | -0.6623 | |
2026.01 | 0.1379 | 73.54 | 0.0279 | -0.5976 | |
2026.01 | 0.1299 | - | 0.0563 | -0.6727 | |
2026.01 | 0.1239 | - | 0.0117 | -0.6788 | |
2026.01 | 0.1177 | 85.75 | 0.1071 | -0.7399 | |
2026.01 | 0.1101 | 85.75 | 0.0612 | -0.7474 | |
2026.01 | 0.1086 | - | 0.0303 | -0.749 | |
2026.01 | 0.1084 | 81.12 | 0.0152 | -0.7028 | |
2026.01 | 0.1011 | - | 0.0679 | -0.7565 | |
2026.01 | 0.0986 | - | 0.0411 | -0.7589 |