Long-context language understanding on SCBench
79KV Retrieval
Llama-3.1-8B
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 79 | 21.7 | 56.8 | 44.1 | 50.4 | - | - | - | - | - | - | - | |
2026.02 | 72.2 | 21.3 | 57 | 46.3 | 49.2 | - | - | - | - | - | - | - | |
2026.02 | 70.4 | 22.9 | 60.7 | 57 | 52.8 | - | - | - | - | - | - | - | |
2026.02 | 69.2 | 22.7 | 61.2 | 56.7 | 52.4 | - | - | - | - | - | - | - | |
2025.12 | 66 | 28.78 | - | - | - | 20.52 | 95.57 | 32.6 | 53.86 | 36.48 | 38.33 | 49.6 | |
2026.02 | 62.4 | 23.4 | 61.3 | 58.2 | 51.3 | - | - | - | - | - | - | - | |
2026.02 | 60.4 | 19.5 | 52.4 | 53 | 46.3 | - | - | - | - | - | - | - | |
2026.02 | 60.4 | 20.7 | 52.2 | 53.7 | 46.8 | - | - | - | - | - | - | - | |
2026.02 | 59.4 | 24 | 60.6 | 58.5 | 50.6 | - | - | - | - | - | - | - | |
2026.02 | 58 | 20.5 | 50 | 51.5 | 45 | - | - | - | - | - | - | - | |
2026.02 | 6.2 | 21.3 | 60.6 | 56.3 | 36.1 | - | - | - | - | - | - | - | |
2025.12 | 2.2 | 6.84 | - | - | - | 5.68 | 100 | 13.2 | 2.96 | 29.21 | 28.25 | 0 | |
2026.02 | 0.4 | 20.3 | 55.7 | 43.7 | 30 | - | - | - | - | - | - | - | |
2025.12 | 0 | 3.7 | - | - | - | 4.8 | 100 | 8 | 0.46 | 8.97 | 6.51 | 0.27 | |
2025.12 | 0 | 6.29 | - | - | - | 10.04 | 100 | 18.6 | 0.23 | 27.9 | 29.28 | 0.31 | |
2025.12 | 0 | 19.09 | - | - | - | 13.1 | 100 | 13.8 | 4.32 | 33.66 | 34.06 | 43.11 |