Long-context understanding on LongBench V1 (QA, Summarization, and Retrieval Subset)
59.63HotpotQA Accuracy
Spec prefill with Llama-3.2-1B-Instruct
Updated 4mo ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 59.63 | 100 | 24.05 | 52.56 | 46.21 | 49.74 | 59.69 | 99 | 55.98 | ||
2026.03 | 59.47 | 100 | 24.03 | 53.84 | 50.49 | 51.13 | 62.45 | 98.5 | 57.34 | |
2026.03 | 55.99 | 100 | 24.9 | 54.32 | 41.09 | 41.33 | 62.4 | 95.25 | 54.29 | |
2026.03 | 55.97 | 99.5 | 25.38 | 55.8 | 44.56 | 43.5 | 62.45 | 97.38 | 55.31 |