Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long-context Open-book Question Answering and Summarization on SCROLLS (val)
Loading...
23.9
NaQA F1 Score
MEGALODON
17.14
18.895
20.65
22.405
Apr 12, 2024
NaQA F1 Score
Qasper F1 Score
QMSum geometric-ROUGE
Updated 1mo ago
Evaluation Results
Method
Method
Links
NaQA F1 Score
Qasper F1 Score
QMSum geometric-ROUGE
MEGALODON
Model size=7B
2024.04
23.9
28
13.1
LLAMA2-L
Model size=7B, Context...
2024.04
23.5
28.3
14.5
YaRN
Model size=7B, Context...
2024.04
20.9
26.2
11.4
MPT
Model size=7B, Context...
2024.04
18.8
24.7
8.8
LLAMA2
Model size=7B, Context...
2024.04
18.8
19.8
10.1
Xgen
Model size=7B, Context...
2024.04
17.4
20.5
6.8
Feedback
Search any
task
Search any
task
