Our new X account is live! Follow @wizwand_team for updates

Question Answering on Scrolls NarraQA

12.29Accuracy

Mistral (Full-Attention)

Updated 4d ago

Evaluation Results

Method	Links
Mistral (Full-Attention) 2024.07		12.29
BMoJo (Fading) 2024.07		9.66
Mamba (SSM) 2024.07		9.62
Mistral (Full-Attention) 2024.07		9.24
BMoJo (Fading + Eidetic) 2024.07		7.64
BMoJo (Fading) 2024.07		7.48
Mamba (SSM) 2024.07		6.04
BMoJo (Fading + Eidetic) 2024.07		5.92
Hybrid (Sliding Attention + SSM) 2024.07		5.35
Hybrid (Sliding Attention + SSM) 2024.07		3.62