Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long-context Retrieval on S-NIAH (Exact Match)
Loading...
99.6
Exact Match Accuracy
Llama3.1 8B Instruct
88.368
91.284
94.2
97.116
May 7, 2026
Exact Match Accuracy
Updated 26d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
Llama3.1 8B Instruct
Adaptation strategy=None
2026.05
99.6
OffShelf-FT-SPEED+BoS-24
Adaptation strategy=SP...
2026.05
99.6
Llama3.1 8B Instruct
2026.05
99.6
OffShelf-FT-SPEED+BoS
SPEED cutoff (K)=24
2026.05
99.6
Full-depth LoRA
Adaptation strategy=Fu...
2026.05
97.7
Full-depth LoRA
2026.05
97.7
OffShelf-FT-SPEED+BoS-28
Adaptation strategy=SP...
2026.05
97
OffShelf-FT-SPEED+BoS
SPEED cutoff (K)=28
2026.05
97
OffShelf-FT-SPEED+BoS-20
Adaptation strategy=SP...
2026.05
96.1
OffShelf-FT-SPEED+BoS
SPEED cutoff (K)=20
2026.05
96.1
OffShelf-FT-SPEED+BoS-16
Adaptation strategy=SP...
2026.05
88.8
OffShelf-FT-SPEED+BoS
SPEED cutoff (K)=16
2026.05
88.8
Feedback
Search any
task
Search any
task