Our new X account is live! Follow @wizwand_team for updates

Needle-in-a-Haystack Retrieval on RULER

100S-NIAH-1 (Pass-Key Retrieval)

Full attention

Updated 4d ago

Evaluation Results

Method	Links
Full attention 2025.12		100	99	64	-	-	-	-	-	-
Full attention 2025.12		100	100	64	-	-	-	-	-	-
Full attention 2025.12		100	100	67	-	-	-	-	-	-
Full attention 2025.12		100	100	83	-	-	-	-	-	-
SWA 2025.12		100	100	57	-	-	-	-	-	-
Hybrid SWA and full 2025.12		100	100	63	-	-	-	-	-	-
Gated DeltaNet 2025.12		100	100	91	-	-	-	-	-	-
TTT-E2E 2025.12		100	99	77	-	-	-	-	-	-
RAT+ 2026.02		100	-	100	100	100	99.6	99.85	100	-
RAT+ 2026.02		100	-	99.2	100	99.2	96	99.8	99.8	-
RAT+ 2026.02		100	-	97.8	99.8	97.4	88.8	99.75	99.5	-
RAT+ 2026.02		100	-	96	99.8	96.4	73.8	99.4	99.15	-
RAT+ 2026.02		100	-	89.2	99.6	95.2	54.6	99.3	98.15	-
RAT+ 2026.02		100	-	78.8	99.2	78	40.4	97.35	96.35	-
RAT+ 2026.02		100	-	76	98.4	46.8	30	97.35	93.9	-
Full attention 2025.12		99	86	64	-	-	-	-	-	-
Mamba 2 2025.12		99	99	77	-	-	-	-	-	-
TTT-KVB 2025.12		98	100	74	-	-	-	-	-	-
Hybrid SWA and full 2025.12		93	100	56	-	-	-	-	-	-
Hybrid SWA and full 2025.12		88	99	32	-	-	-	-	-	-
Hybrid SWA and full 2025.12		69	89	17	-	-	-	-	-	-
SWA 2025.12		50	43	41	-	-	-	-	-	-
Gated DeltaNet 2025.12		50	43	45	-	-	-	-	-	-
Mamba 2 2025.12		49	43	36	-	-	-	-	-	-
TTT-E2E 2025.12		46	43	44	-	-	-	-	-	-
TTT-KVB 2025.12		43	43	34	-	-	-	-	-	-
SWA 2025.12		26	28	24	-	-	-	-	-	-
Mamba 2 2025.12		26	28	24	-	-	-	-	-	-
Gated DeltaNet 2025.12		26	27	23	-	-	-	-	-	-
TTT-E2E 2025.12		24	28	24	-	-	-	-	-	-
TTT-KVB 2025.12		22	27	23	-	-	-	-	-	-
Hybrid SWA and full 2025.12		21	29	6	-	-	-	-	-	-
SWA 2025.12		13	16	9	-	-	-	-	-	-
Mamba 2 2025.12		13	16	8	-	-	-	-	-	-
Gated DeltaNet 2025.12		13	16	7	-	-	-	-	-	-
TTT-E2E 2025.12		13	16	10	-	-	-	-	-	-
TTT-KVB 2025.12		10	16	6	-	-	-	-	-	-
SWA 2025.12		7	5	5	-	-	-	-	-	-
Mamba 2 2025.12		7	5	4	-	-	-	-	-	-
Gated DeltaNet 2025.12		7	5	3	-	-	-	-	-	-
TTT-E2E 2025.12		6	5	3	-	-	-	-	-	-
TTT-KVB 2025.12		1	5	4	-	-	-	-	-	-