Share your thoughts, 1 month free Claude Pro on usSee more

Long-Context Retrieval on RULER 128K

94.67Score

HiLS-Attn HoPE-Q-Cal

Updated 19d ago

Evaluation Results

Method	Links
HiLS-Attn HoPE-Q-Cal 2026.07		94.67
Nemotron-3-Ultra 550B-A55B-Base 2026.06		92.49
DeepSeek-V3.2 Exp-Base 2026.06		91.88
Kimi-K2 Base 2026.06		88.61
Hybrid-KSA 2026.04		71.67
Hybrid-Linear 2026.04		67.98
KSA 2026.04		66.81
Hybrid-SWA 2026.04		66.27
Full Attention 2026.04		65.86
Hybrid-KSA 2026.04		65.35
Hybrid-SCA 2026.04		60.94
Hybrid-GDN 2026.04		59.87
Hybrid-SCA 2026.04		58.01
Hybrid-SWA 2026.04		56.64
Mistral-Large-3 675B-Base-2512 2026.06		55.77
Full 2026.04		48.75
KSA 2026.04		39.29
HiLS-Attn RoPE-Q-Cal 2026.07		1
LMK token tuning 2026.07		0.67
GLM-4.5 Base 2026.06		0
Olmo3 Base 2026.07		0
Olmo3 512swa 2026.07		0
HiLS-Attn NoPE-Q-Cal 2026.07		0