Multi-task Language Evaluation on 16-task evaluation suite 1B/25B checkpoints (test)
42.22Average Score
HERMES + L12 quality top-30%
Updated 23d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.07 | 42.22 | 1.628 | |
| 41.55 | 1.048 | ||
2026.07 | 41.53 | 1.059 | |
2026.07 | 41.34 | 0.949 | |
| 40.82 | 0.508 | ||
| 40.79 | 0.469 | ||
| 40.61 | 0.317 | ||
| 40.45 | 0.114 | ||
| 40.29 | 0.128 | ||
| 40.28 | 0.048 | ||
| 39.94 | 0.312 | ||
| 39.92 | 0.362 | ||
| 39.88 | 0.294 | ||
| 39.86 | 0.302 | ||
| 39.69 | 0.458 | ||
| 39.34 | 0.747 | ||
2026.07 | 38.89 | 1.147 | |
| 38.87 | 1.163 | ||
| 38.86 | 1.181 | ||
| 37.98 | 1.885 |