| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| NIAH multivalue | FLy | Speedup4.1 | 20 | 4d ago | |
| RULER | MrRoPE-Pro | Retrieval Accuracy (8K)96.2 | 17 | 4d ago | |
| RULER 64K context | WindowedManifoldKV | Accuracy84.3 | 13 | 4d ago | |
| NIAH-Multi | Kimi-K2 | Accuracy100 | 13 | 4d ago | |
| Needle-in-a-Haystack | Retrieval Accuracy100 | 10 | 4d ago | ||
| RULER 4K-32K context | ManifoldKV | Accuracy95.73 | 8 | 4d ago | |
| Probing (val) | FILM-7B | Document Avg85.4 | 8 | 4d ago | |
| NIAH (avg) | Qwen2.5-14B-Instruct-1M | Score (4k Context)100 | 7 | 4d ago | |
| NIAH 32k | PHSA | NIAH Score99 | 6 | 4d ago | |
| NIAH 16k | PHSA | NIAH Score98.6 | 6 | 4d ago | |
| NIH | Multi-needle Avg Recall100 | 6 | 4d ago | ||
| Needle-in-a-Haystack 1.0 (test) | FastKV | Score99.9 | 5 | 4d ago | |
| RULER | INF-V2 | Retrieval Accuracy (4K Context)95.9 | 5 | 4d ago | |
| Needle-in-a-Haystack (NiH) | Accuracy (512 tokens)100 | 3 | 4d ago |
