Needle-in-a-Haystack Retrieval on RULER
100S-NIAH-1 (Pass-Key Retrieval)
Full attention
Updated 12d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2025.12 | 100 | 99 | 64 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 64 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 67 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 83 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 57 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 63 | - | - | - | - | - | - | |
2025.12 | 100 | 100 | 91 | - | - | - | - | - | - | |
2025.12 | 100 | 99 | 77 | - | - | - | - | - | - | |
2026.02 | 100 | - | 100 | 100 | 100 | 99.6 | 99.85 | 100 | - | |
2026.02 | 100 | - | 99.2 | 100 | 99.2 | 96 | 99.8 | 99.8 | - | |
2026.02 | 100 | - | 97.8 | 99.8 | 97.4 | 88.8 | 99.75 | 99.5 | - | |
2026.02 | 100 | - | 96 | 99.8 | 96.4 | 73.8 | 99.4 | 99.15 | - | |
2026.02 | 100 | - | 89.2 | 99.6 | 95.2 | 54.6 | 99.3 | 98.15 | - | |
2026.02 | 100 | - | 78.8 | 99.2 | 78 | 40.4 | 97.35 | 96.35 | - | |
2026.02 | 100 | - | 76 | 98.4 | 46.8 | 30 | 97.35 | 93.9 | - | |
2026.05 | 100 | 99.6 | 59.2 | 29 | - | - | - | - | - | |
2026.05 | 100 | 99.6 | 38.6 | 21.2 | - | - | - | - | - | |
2026.05 | 100 | 100 | 54.2 | 37 | - | - | - | - | - | |
2026.05 | 100 | 87.2 | 60.6 | 27.8 | - | - | - | - | - | |
2026.05 | 100 | 100 | 77.4 | 54 | - | - | - | - | - | |
2026.05 | 100 | 100 | 63.2 | 44.2 | - | - | - | - | - | |
2026.05 | 100 | 99.8 | 60.2 | 44.8 | - | - | - | - | - | |
2026.05 | 100 | 99.8 | 89.2 | 49.4 | - | - | - | - | - | |
2026.05 | 100 | 100 | 92 | 72.6 | - | - | - | - | - | |
2026.05 | 100 | 100 | 89.8 | 51.4 | - | - | - | - | - | |
2026.05 | 100 | 93 | 31.8 | 37.8 | - | - | - | - | - | |
2026.05 | 100 | 100 | 95.8 | 75.6 | - | - | - | - | - | |
2026.05 | 100 | 100 | 94.8 | 66.6 | - | - | - | - | - | |
2026.05 | 100 | 100 | 97.8 | 82 | - | - | - | - | - | |
2026.05 | 100 | 99.6 | 86.8 | 58.6 | - | - | - | - | - | |
2026.05 | 100 | 100 | 94.8 | 91 | - | - | - | - | - | |
2026.05 | 100 | 99.8 | 91.2 | 78.4 | - | - | - | - | - | |
2026.05 | 100 | 100 | 97.2 | 91.4 | - | - | - | - | - | |
2026.05 | 100 | 100 | 93.4 | 84 | - | - | - | - | - | |
2026.05 | 100 | 100 | 95 | 78.8 | - | - | - | - | - | |
2026.05 | 100 | 100 | 90.4 | 65.6 | - | - | - | - | - | |
2026.05 | 100 | 100 | 99.4 | 82.4 | - | - | - | - | - | |
2026.05 | 100 | 100 | 98.4 | 79 | - | - | - | - | - | |
2026.05 | 100 | 100 | 99.6 | 93 | - | - | - | - | - | |
2026.05 | 100 | 100 | 99 | 84.6 | - | - | - | - | - | |
2026.05 | 99.8 | 100 | 89.8 | 58 | - | - | - | - | - | |
2026.05 | 99.8 | 98.8 | 72.4 | 19.2 | - | - | - | - | - | |
2026.05 | 99.2 | 89 | 26.2 | 28 | - | - | - | - | - | |
2025.12 | 99 | 86 | 64 | - | - | - | - | - | - | |
2025.12 | 99 | 99 | 77 | - | - | - | - | - | - | |
2026.05 | 99 | 99 | 35.6 | 27.4 | - | - | - | - | - | |
2025.12 | 98 | 100 | 74 | - | - | - | - | - | - | |
2026.05 | 97.8 | 39.2 | - | - | - | - | - | - | - | |
2026.05 | 97.6 | 32 | - | - | - | - | - | - | - | |
2026.05 | 97 | 62.6 | 14.4 | 21.4 | - | - | - | - | - | |
2025.12 | 93 | 100 | 56 | - | - | - | - | - | - | |
2026.05 | 93 | 64.2 | 29.2 | 18 | - | - | - | - | - | |
2025.12 | 88 | 99 | 32 | - | - | - | - | - | - | |
2026.05 | 70.6 | 30.6 | - | - | - | - | - | - | - | |
2025.12 | 69 | 89 | 17 | - | - | - | - | - | - | |
2026.05 | 63.4 | 59.4 | 12.2 | 20.2 | - | - | - | - | - | |
2026.05 | 55.8 | 21 | - | - | - | - | - | - | - | |
2026.05 | 55.2 | 57.9 | 55.6 | 48 | - | - | - | - | - | |
2026.05 | 51.8 | 52.4 | 48 | 39 | - | - | - | - | - | |
2026.05 | 51.8 | 56 | 51.6 | 40.4 | - | - | - | - | - | |
2026.05 | 51.2 | 44.2 | 37 | 38.2 | - | - | - | - | - | |
2025.12 | 50 | 43 | 41 | - | - | - | - | - | - | |
2025.12 | 50 | 43 | 45 | - | - | - | - | - | - | |
2026.05 | 49.6 | 58.2 | 44 | 33.6 | - | - | - | - | - | |
2025.12 | 49 | 43 | 36 | - | - | - | - | - | - | |
2026.05 | 49 | 53 | 54.2 | 46.6 | - | - | - | - | - | |
2026.05 | 47.2 | 57.3 | 47.2 | 44.8 | - | - | - | - | - | |
2025.12 | 46 | 43 | 44 | - | - | - | - | - | - | |
2025.12 | 43 | 43 | 34 | - | - | - | - | - | - | |
2026.05 | 35.6 | 27.2 | - | - | - | - | - | - | - | |
2026.05 | 27.8 | 25.2 | - | - | - | - | - | - | - | |
2026.05 | 27.4 | 29.2 | - | - | - | - | - | - | - | |
2026.05 | 26.2 | 23 | - | - | - | - | - | - | - | |
2025.12 | 26 | 28 | 24 | - | - | - | - | - | - | |
2025.12 | 26 | 28 | 24 | - | - | - | - | - | - | |
2025.12 | 26 | 27 | 23 | - | - | - | - | - | - | |
2026.05 | 26 | 27.8 | - | - | - | - | - | - | - | |
2026.05 | 25.4 | 25.8 | - | - | - | - | - | - | - | |
2025.12 | 24 | 28 | 24 | - | - | - | - | - | - | |
2026.05 | 22.8 | 27.8 | - | - | - | - | - | - | - | |
2026.05 | 22.4 | 25.6 | - | - | - | - | - | - | - | |
2025.12 | 22 | 27 | 23 | - | - | - | - | - | - | |
2025.12 | 21 | 29 | 6 | - | - | - | - | - | - | |
2025.12 | 13 | 16 | 9 | - | - | - | - | - | - | |
2025.12 | 13 | 16 | 8 | - | - | - | - | - | - | |
2025.12 | 13 | 16 | 7 | - | - | - | - | - | - | |
2025.12 | 13 | 16 | 10 | - | - | - | - | - | - | |
2025.12 | 10 | 16 | 6 | - | - | - | - | - | - | |
2025.12 | 7 | 5 | 5 | - | - | - | - | - | - | |
2025.12 | 7 | 5 | 4 | - | - | - | - | - | - | |
2025.12 | 7 | 5 | 3 | - | - | - | - | - | - | |
2025.12 | 6 | 5 | 3 | - | - | - | - | - | - | |
2025.12 | 1 | 5 | 4 | - | - | - | - | - | - | |
2026.05 | 0 | 0 | - | - | - | - | - | - | - |