MMLU Question Answering (Accuracy and Performance Gain)
78.7Accuracy
Mistral Small 24B Inst 2501
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 78.7 | -0.6 | |
2026.01 | 78.5 | -0.8 | |
2026.01 | 76.7 | -1.5 | |
2026.01 | 76.6 | -1.6 | |
2026.01 | 65.3 | -0.1 | |
2026.01 | 65.3 | -0.1 | |
2026.01 | 63.9 | -0.8 | |
2026.01 | 63.6 | -1.1 | |
2026.01 | 62.6 | -1.3 | |
2026.01 | 62.3 | -1.6 | |
2026.01 | 60.2 | 1 | |
2026.01 | 59.3 | -1 | |
2026.01 | 58.7 | -1.3 | |
2026.01 | 58.7 | -1.6 | |
2026.01 | 58.7 | -0.4 | |
2026.01 | 58.5 | -0.1 | |
2026.01 | 58.5 | -1.5 | |
2026.01 | 58.4 | -0.2 | |
2026.01 | 55.9 | -1.1 | |
2026.01 | 55.4 | -1.6 | |
2026.01 | 45.9 | 0.1 | |
2026.01 | 45.6 | -0.2 | |
2026.01 | 43.8 | 1.5 | |
2026.01 | 41.1 | -1.1 |