Language Understanding on MMLU (Accuracy, Throughput, and Latency)
84.9Accuracy
Verify-Only
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.12 | 84.9 | 10.952 | 0.408 | 1.042 | |
2025.12 | 84.5 | 4.69 | - | 0.446 | |
2025.12 | 84.1 | 10.735 | - | 1.021 | |
2025.12 | 83.8 | 8.746 | - | 1 | |
2025.12 | 83.7 | 10.511 | - | 1 | |
2025.12 | 83.7 | 11.436 | - | 1.088 | |
2025.12 | 83.6 | 4.376 | - | 0.553 | |
2025.12 | 83.6 | 4.376 | - | 0.5 | |
2025.12 | 83.5 | 7.912 | - | 1 | |
2025.12 | 83.5 | 7.97 | - | 1.007 | |
2025.12 | 83.5 | 9.085 | - | 1.039 | |
2025.12 | 83.5 | 11.395 | 0.407 | 1.084 | |
2025.12 | 83.3 | 8.481 | 0.418 | 1.072 | |
2025.12 | 83.3 | 8.92 | - | 1.02 | |
2025.12 | 83.1 | 8.023 | - | 1.014 | |
2025.12 | 82.2 | 8.623 | 0.419 | 1.09 | |
2025.12 | 81.6 | 9.385 | 0.465 | 1.073 | |
2025.12 | 81.3 | 9.937 | 0.463 | 1.136 | |
2025.12 | 80.81 | - | - | 1.56 | |
2025.12 | 80.81 | - | - | 1.56 | |
2025.12 | 80.77 | - | - | 1.62 | |
2025.12 | 80.76 | - | - | 1.43 | |
2025.12 | 80.75 | - | - | 1.43 | |
2025.12 | 80.69 | - | - | 1 | |
2025.12 | 80.69 | - | - | 1.54 | |
2025.12 | 79.31 | - | - | 5 | |
2025.12 | 79.31 | - | - | 2.5 | |
2025.12 | 78.73 | - | - | 1.14 | |
2025.12 | 72.5 | 38.544 | - | 3.667 | |
2025.12 | 69.5 | 33.274 | - | 4.206 | |
2025.12 | 45.3 | 95.141 | - | 10.878 |