Multitask Language Understanding on MMLU (val)
74.12Accuracy
GWT
Updated 18d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2025.01 | 74.12 | 70.38 | 83.88 | 68.06 | 77.14 | |
2025.01 | 73.85 | 70.44 | 83.23 | 67.8 | 76.9 | |
2025.01 | 73.77 | 70.51 | 83.43 | 67.35 | 76.96 | |
2025.01 | 73.76 | 70.21 | 83.49 | 67.52 | 76.87 | |
2024.05 | 63.16 | - | - | - | - | |
2024.05 | 61.87 | - | - | - | - | |
2024.05 | 61.82 | - | - | - | - | |
2024.05 | 61.78 | - | - | - | - | |
2024.05 | 61.42 | - | - | - | - | |
2024.05 | 60.84 | - | - | - | - | |
2024.05 | 60.6 | - | - | - | - | |
2024.05 | 60.07 | - | - | - | - | |
2025.01 | 59.4 | 49.5 | 68.25 | 56.28 | 64.74 | |
2024.05 | 59.38 | - | - | - | - | |
2025.01 | 59.37 | 49.73 | 68.7 | 55.94 | 64.47 | |
2025.01 | 59.34 | 49.5 | 68.61 | 56.56 | 64.62 | |
2025.01 | 59.32 | 49.17 | 68.18 | 56.32 | 64.71 | |
2025.01 | 59.23 | 49.83 | 67.63 | 56.56 | 63.88 | |
2024.05 | 57.69 | - | - | - | - | |
2024.05 | 57.29 | - | - | - | - | |
2024.05 | 57.15 | - | - | - | - | |
2024.05 | 57.01 | - | - | - | - | |
2024.05 | 56.52 | - | - | - | - | |
2024.05 | 55.03 | - | - | - | - | |
2024.05 | 54.89 | - | - | - | - | |
2025.01 | 54.56 | 46.39 | 64.87 | 49.73 | 59.38 | |
2025.01 | 54.46 | 46.59 | 64.74 | 49.71 | 58.91 | |
2025.01 | 54.26 | 46.36 | 64.51 | 49.42 | 58.91 | |
2025.01 | 54.17 | 46.49 | 64.28 | 49.39 | 58.67 | |
2025.01 | 53.41 | 45.36 | 63.41 | 48.63 | 58.36 | |
2025.12 | 52.1 | - | - | - | - | |
2025.12 | 49.7 | - | - | - | - | |
2025.12 | 48 | - | - | - | - | |
2024.05 | 46.99 | - | - | - | - | |
2025.12 | 45.4 | - | - | - | - | |
2024.05 | 45.34 | - | - | - | - | |
2025.12 | 45.1 | - | - | - | - | |
2024.05 | 45.09 | - | - | - | - | |
2024.05 | 44.13 | - | - | - | - | |
2025.12 | 44.1 | - | - | - | - | |
2024.05 | 43.73 | - | - | - | - | |
2024.05 | 43.62 | - | - | - | - | |
2024.05 | 43.48 | - | - | - | - | |
2024.05 | 43.29 | - | - | - | - | |
2024.05 | 42.58 | - | - | - | - | |
2024.05 | 42.54 | - | - | - | - | |
2024.05 | 42.39 | - | - | - | - | |
2024.05 | 42.3 | - | - | - | - | |
2024.05 | 41.91 | - | - | - | - | |
2024.05 | 41.67 | - | - | - | - | |
2025.12 | 41.3 | - | - | - | - | |
2025.12 | 41.3 | - | - | - | - | |
2024.05 | 41.21 | - | - | - | - | |
2024.05 | 41.18 | - | - | - | - | |
2025.12 | 37.8 | - | - | - | - | |
2025.12 | 34 | - | - | - | - | |
2025.12 | 33 | - | - | - | - | |
2025.12 | 32.1 | - | - | - | - | |
2025.12 | 31.6 | - | - | - | - | |
2025.12 | 29.6 | - | - | - | - | |
2025.12 | 29.3 | - | - | - | - | |
2025.12 | 28.5 | - | - | - | - | |
2025.12 | 27.1 | - | - | - | - | |
2025.12 | 26.7 | - | - | - | - | |
2024.05 | 25.51 | - | - | - | - | |
2024.05 | 25.37 | - | - | - | - | |
2025.12 | 25.1 | - | - | - | - | |
2024.05 | 25 | - | - | - | - | |
2025.12 | 24 | - | - | - | - | |
2024.05 | 23.88 | - | - | - | - | |
2025.12 | 23.8 | - | - | - | - | |
2025.12 | 23.2 | - | - | - | - |