Long-context reasoning on RULER (Context Length Sweep 8K-64K)
75.3RULER Performance (8K Context)
HyLo-Llama-14MLA14M2
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 75.3 | 49.7 | 16.6 | 0.4 | |
2026.04 | 74.2 | 58.6 | 33.5 | 10.7 | |
2026.04 | 73.9 | 62.6 | - | 33.1 | |
2026.04 | 73.2 | 69.7 | 62.9 | 52 | |
2026.04 | 71.7 | 65.4 | - | 46.6 | |
2026.04 | 71.3 | 60.1 | 43.9 | 14.1 | |
2026.04 | 71.2 | 45 | 27.1 | 14.1 | |
2026.04 | 71.1 | 45.6 | 19.2 | 0.2 | |
2026.04 | 71.1 | 45.6 | 19.2 | 0.2 | |
2026.04 | 68.2 | 62.1 | 55.7 | 46.3 | |
2026.04 | 66.9 | 53.2 | 41.4 | 31.6 | |
2026.04 | 65.7 | 39.5 | 25.2 | 11.4 | |
2026.04 | 65.4 | 56.4 | 49.9 | 42.3 | |
2026.04 | 63.5 | 43.6 | 30.3 | 17.4 | |
2026.04 | 63.5 | 43.6 | 30.3 | 17.4 | |
2026.04 | 61.5 | 53.7 | 48.1 | 41.6 | |
2026.04 | 60.3 | 0.5 | 0.1 | 0.1 | |
2026.04 | 59.8 | 53.8 | 42.5 | 30.5 | |
2026.04 | 59 | 0.3 | 0.1 | 0 | |
2026.04 | 59 | 52.5 | 45.5 | 38.8 | |
2026.04 | 58.7 | 41.1 | 27.5 | 14.6 | |
2026.04 | 56.5 | 49 | 38.4 | 27.8 | |
2026.04 | 55.1 | 11.9 | 2.4 | 0.8 | |
2026.04 | 53.3 | 46.7 | 40.4 | 37.9 | |
2026.04 | 53.1 | 10.6 | 2 | 0.5 | |
2026.04 | 52.5 | 48.3 | 44.5 | 40.8 | |
2026.04 | 42.5 | 0.4 | 0.5 | 0.3 | |
2026.04 | 37 | 1 | 0 | 0 | |
2026.04 | 36.4 | 31.3 | 23.8 | 16.4 | |
2026.04 | 35.1 | 13.3 | 6.3 | 4.2 | |
2026.04 | 18.9 | 3 | 1 | 0 | |
2026.04 | 12.3 | 6.8 | 3.7 | 0.1 | |
2026.04 | 3.5 | 0 | 0 | 0 | |
2026.04 | 2.9 | 0 | 0 | 0 | |
2026.04 | 0.5 | 0 | 0.1 | 0 |