Share your thoughts, 1 month free Claude Pro on usSee more

Long-context Retrieval on S-NIAH (Exact Match)

99.6Exact Match Accuracy

Llama3.1 8B Instruct

Updated 2mo ago

Evaluation Results

Method	Links
Llama3.1 8B Instruct 2026.05		99.6
OffShelf-FT-SPEED+BoS-24 2026.05		99.6
Llama3.1 8B Instruct 2026.05		99.6
OffShelf-FT-SPEED+BoS 2026.05		99.6
Full-depth LoRA 2026.05		97.7
Full-depth LoRA 2026.05		97.7
OffShelf-FT-SPEED+BoS-28 2026.05		97
OffShelf-FT-SPEED+BoS 2026.05		97
OffShelf-FT-SPEED+BoS-20 2026.05		96.1
OffShelf-FT-SPEED+BoS 2026.05		96.1
OffShelf-FT-SPEED+BoS-16 2026.05		88.8
OffShelf-FT-SPEED+BoS 2026.05		88.8