| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Needle In A Haystack | KV-CAT | Exact-match Accuracy67 | 40 | 2mo ago | |
| Needle Retrieval | Topological Attention | Time (ms)6.5 | 9 | 4mo ago | |
| NIAH | Qwen3 w/ MATCH | Success Rate (8K, Single)100 | 6 | 25d ago | |
| 4-digit-magic-number needle retrieval 4k window | Accuracy100 | 6 | 1mo ago | ||
| NIAH 64K 10 needles per trial (test) | Accuracy66 | 2 | 2mo ago | ||
| NIAH 32K 10 needles per trial (test) | Accuracy51 | 2 | 2mo ago | ||
| NIAH 8K 10 needles per trial (test) | Accuracy39 | 2 | 2mo ago |
