Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
In-context retrieval on RULER 32K
Loading...
100
S-N Score
HiLS-Attn-HoPE
1.2
26.85
52.5
78.15
Jul 3, 2026
S-N Score
MK-MQ Score
VT Score
Updated 18d ago
Evaluation Results
Method
Method
Links
S-N Score
MK-MQ Score
VT Score
HiLS-Attn-HoPE
Parameters=345M
2026.07
100
95
68
Naive-BSA-HoPE
Parameters=345M
2026.07
98
77
13
Full-Attn HoPE (extra MLP)
Parameters=345M
2026.07
83
19
1
HSA-Ultralong
Parameters=345M
2026.07
82
74
15
Full-Attn HoPE
Parameters=345M
2026.07
72
11
11
SWA-RoPE
Parameters=345M
2026.07
8
2
7
NSA-RoPE
Parameters=345M
2026.07
5
0
0
Feedback
Search any
task
Search any
task