Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on QASPER Extractive (test)
Loading...
53.3
F1
LongT5-large
17.732
26.966
36.2
45.434
Jun 1, 2021
Aug 19, 2021
Nov 7, 2021
Jan 25, 2022
Apr 15, 2022
Jul 3, 2022
Sep 21, 2022
F1
EM
Updated 4d ago
Evaluation Results
Method
Method
Links
F1
EM
LongT5-large
Model size=large
2022.09
53.3
-
LongT5-3B
Model size=3B
2022.09
53.1
-
BART-LS
2022.09
48.7
-
LongT5-base
Model size=base
2022.09
46.6
-
DOCHOPPER
runtime=74.6/s
2021.06
36.4
19.5
LED
runtime=0.5/s
2021.06
31
-
Sequential (ETC)
runtime=0.6±0.1/s
2021.06
27
12.4
Retrieval + ETC
retriever=BM25, runtim...
2021.06
19.1
9.6
Feedback
Search any
task
Search any
task