NIAH-Single
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Needle-in-a-Haystack retrieval | NIAH-Single-2 256K context | Accuracy95.2 | 23 | |
| Needle-in-a-Haystack retrieval | NIAH-Single 128K context 2 | Accuracy98.6 | 23 | |
| Needle-in-a-Haystack retrieval | NIAH-Single-1 32K context | Accuracy (NIAH-Single-1 32K)100 | 23 | |
| Long-context retrieval | NIAH-Single-3 (256K) | Accuracy76.4 | 12 | |
| Long-context retrieval | NIAH-Single-2 (128K context) | Accuracy97 | 12 | |
| Long-context retrieval | NIAH-Single-2 64K context | Accuracy100 | 12 | |
| Long-context retrieval | NIAH-Single-2 32K context | Accuracy99.8 | 12 | |
| Long-context retrieval | NIAH-Single-1 64K | Accuracy100 | 12 |
Showing 8 of 8 rows