Mathematical Reasoning on MMLU STEM
77.8Accuracy
FP16
Updated 12d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.08 | 77.8 | - | |
2024.05 | 77.1 | - | |
2024.05 | 71.8 | - | |
2024.05 | 71.5 | - | |
2024.05 | 68.8 | - | |
2025.08 | 68.7 | - | |
2024.05 | 66.9 | - | |
2025.08 | 66.5 | - | |
2024.05 | 65.7 | - | |
2024.05 | 64 | - | |
2024.05 | 63.5 | - | |
2024.05 | 62.3 | - | |
2024.05 | 62.3 | - | |
2024.05 | 60.4 | - | |
2024.05 | 57.9 | - | |
2024.05 | 57.7 | - | |
2024.05 | 56.1 | - | |
2024.05 | 54.9 | - | |
2024.05 | 54.4 | - | |
2024.05 | 54.3 | - | |
2024.05 | 53.6 | - | |
2024.05 | 49.5 | - | |
2024.05 | 45.8 | - | |
2025.10 | - | 49.8 | |
2025.10 | - | 47.7 | |
2025.10 | - | 54.9 | |
2025.10 | - | 57.4 | |
2025.10 | - | 56.2 | |
2025.10 | - | 55.2 | |
2025.10 | - | 22.3 | |
2025.10 | - | 26.2 | |
2025.10 | - | 26.2 | |
2025.10 | - | 69.8 | |
2025.10 | - | 68.5 | |
2025.10 | - | 70.5 | |
2025.10 | - | 69.3 | |
2025.10 | - | 68.2 | |
2025.10 | - | 67.8 |