Share your thoughts, 1 month free Claude Pro on usSee more

Needle-in-a-Haystack

100Accuracy

RoPE SSMax

Updated 1mo ago

Evaluation Results

Method	Links
RoPE SSMax 2025.05		100
RoPE SSMax 2025.05		100
RoPE SSMax 2025.05		100
RoPE SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		100
BAM SSMax 2025.05		98
SpindleKV 2025.07		97.9
SpindleKV 2025.07		97.5
PyramidKV 2025.07		96.2
ALiBi SSMax 2025.05		96
KV-Latent Distill (L3-8B) 2025.07		94
PyramidKV 2025.07		93.8
L3-8B (Base) 2025.07		92
KV-Latent Train (L3-8B) 2025.07		92
BAM SSMax 2025.05		92
BAM SSMax 2025.05		88
RoPE SSMax 2025.05		64
PyramidInfer 2025.07		62.1
PyramidInfer 2025.07		61.5
RoPE Local 2025.05		40
L2-7B (Base) 2025.07		32
ALiBi SSMax 2025.05		26
KV-Latent Train (L2-7B) 2025.07		24
RoPE Local 2025.05		24
ALiBi SSMax 2025.05		22
RoPE Local 2025.05		22
RoPE Local 2025.05		20
ALiBi SSMax 2025.05		18
ALiBi SSMax 2025.05		16
RoPE Local 2025.05		12
ALiBi SSMax 2025.05		10
RoPE Local 2025.05		8
KV-Latent Train (L3-8B, d=16) 2025.07		6
KV-Latent Distill (L2-7B) 2025.07		4
NoPE SSMax 2025.05		4
ALiBi SSMax 2025.05		4
ALiBi SSMax 2025.05		2
ALiBi SSMax 2025.05		2
RoPE Local 2025.05		2