Our new X account is live! Follow @wizwand_team for updates

Long-context language understanding on RULER 32k context length

87.5Average Score

Quest

Updated 4d ago

Evaluation Results

Method	Links
Quest 2026.02		87.5	-	-	-	-	97.6	89.7	85	54	100	99
PQcache 2026.02		86.9	-	-	-	-	98.2	92.7	81	51	100	99
SOCKET 2026.02		86.8	-	-	-	-	95.2	91.7	84	53	97	100
Quest 2026.02		86.8	-	-	-	-	95	88.3	86	53	100	99
PQcache 2026.02		86.2	-	-	-	-	96.4	92.3	81	51	98	99
HashAttn 2026.02		85.6	-	-	-	-	94.2	93.7	83	49	97	97
SOCKET 2026.02		85.5	-	-	-	-	94.2	88.7	82	53	95	100
DS 2026.02		85.3	-	-	-	-	97.8	93	81	51	91	98
Quest 2026.02		83.8	-	-	-	-	91.4	87.7	84	54	90	96
DS 2026.02		83.4	-	-	-	-	95.2	92.3	74	51	91	97
PQcache 2026.02		83.1	-	-	-	-	94.2	87.7	82	50	93	92
SOCKET 2026.02		82.7	-	-	-	-	91.4	86	82	52	93	92
HashAttn 2026.02		80.4	-	-	-	-	88.6	92.3	79	50	87	86
DS 2026.02		72	-	-	-	-	90.2	92.3	68	51	49	82
SOCKET 2026.02		71.9	-	-	-	-	83.6	64	77	50	83	74
PQcache 2026.02		69.5	-	-	-	-	86	83.3	73	49	64	62
HashAttn 2026.02		69.1	-	-	-	-	81	89.7	75	51	73	45
Full Attention 2026.02		65.9	99.2	97.4	96.5	81.9	19.8	0	70.6	51.6	-	-
Quest 2026.02		64.1	-	-	-	-	76	80	71	54	74	30
LycheeDecode 2026.02		59.4	97.8	82	94.9	65.1	19.8	0	66.2	49.6	-	-
HashAttn 2026.02		49.4	-	-	-	-	72.2	83.7	63	46	32	0
DS 2026.02		44.6	-	-	-	-	66.4	88.3	48	44	20	1
MagicPig 2026.02		44.1	-	-	-	-	82.8	91.7	38	42	10	0
MagicPig 2026.02		30.2	-	-	-	-	32.2	83	35	29	2	0
MagicPig 2026.02		24.8	-	-	-	-	0	83	35	29	2	0
Qwen 1.5 (1.8B) 2026.01		24.1	-	-	-	-	-	-	-	-	-	-
MagicPig 2026.02		16.2	-	-	-	-	0	61.7	11	24	1	0
RWKV7 (1.5B) 2026.01		11.7	-	-	-	-	-	-	-	-	-	-
Qwen 1.5 (1.8B) 2026.01		9.3	-	-	-	-	-	-	-	-	-	-
RWKV7 (1.5B) 2026.01		9.2	-	-	-	-	-	-	-	-	-	-