Long-context language modeling evaluation on HELMET held-out eval
57.61Accuracy (8K Context)
Qwen 2.5 32B
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.12 | 57.61 | 56.06 | 54.01 | 41.73 | |
2025.12 | 52.11 | 49.36 | 48.6 | 43.15 | |
2025.12 | 51.62 | 49.9 | 47.71 | - | |
2025.12 | 50.57 | 49.68 | 46.01 | - | |
2025.12 | 49.41 | 49.71 | 47.46 | 43.34 | |
2025.12 | 49.37 | 49.92 | 50.31 | 48.6 | |
2025.12 | 49.26 | 46.25 | 42.99 | 30.47 | |
2025.12 | 46.09 | 43.71 | 41.26 | 35.12 | |
2025.12 | 45.66 | 43.62 | 41.15 | 36.8 | |
2025.12 | 45 | 43.48 | 42.44 | 40.18 | |
2025.12 | 44.72 | 44.6 | 41.07 | 35.67 | |
2025.12 | 43.19 | 41.63 | 39.31 | 35.74 | |
2025.12 | 41.78 | 42.9 | 41.82 | 41.48 |