Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on Scrolls QASPER
Loading...
14.8
Accuracy
Mistral (Full-Attention)
7.3432
9.2791
11.215
13.1509
Jul 8, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Mistral (Full-Attention)
Parameters=790M, Zero-...
2024.07
14.8
Mistral (Full-Attention)
Parameters=370M, Zero-...
2024.07
13.35
BMoJo (Fading)
Parameters=790M, Zero-...
2024.07
12.8
Mamba (SSM)
Parameters=790M, Zero-...
2024.07
12.43
BMoJo (Fading + Eidetic)
Parameters=790M, Zero-...
2024.07
11.05
BMoJo (Fading)
Parameters=370M, Zero-...
2024.07
10.29
Mamba (SSM)
Parameters=370M, Zero-...
2024.07
9.54
BMoJo (Fading + Eidetic)
Parameters=370M, Zero-...
2024.07
9.02
Hybrid (Sliding Attention + SSM)
Parameters=370M, Zero-...
2024.07
7.77
Hybrid (Sliding Attention + SSM)
Parameters=790M, Zero-...
2024.07
7.63
Feedback
Search any
task
Search any
task