Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Conversational Question Answering on ShARC Long (dev)
Loading...
72.4
Easy Accuracy
DOCHOPPER
60.648
63.699
66.75
69.801
Jun 1, 2021
Easy Accuracy
Strict Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Easy Accuracy
Strict Accuracy
DOCHOPPER
query update=w/o query...
2021.06
72.4
59.9
DOCHOPPER
runtime=164.3/s
2021.06
72.3
60.2
DOCHOPPER
number of hops=single-hop
2021.06
68
52.7
Retrieval + DISCERN
runtime=42.0/s
2021.06
65.2
50.7
Sequential (DISCERN)
runtime=8.8/s
2021.06
63.7
54.2
DOCHOPPER
input granularity=sent...
2021.06
62.2
43.2
ETC
runtime=11.2/s
2021.06
61.1
-
Feedback
Search any
task
Search any
task