Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on OTT-QA (test)
Loading...
54.9
EM
COS
6.54
19.095
31.65
44.205
Dec 14, 2021
Mar 8, 2022
May 31, 2022
Aug 24, 2022
Nov 16, 2022
Feb 8, 2023
May 4, 2023
EM
F1
Updated 4d ago
Evaluation Results
Method
Method
Links
EM
F1
COS
Reader=Fusion-in-Encod...
2023.05
54.9
61.5
CORE
2023.05
47.3
54.1
OTTer
2023.05
37.3
43.1
MITQA
2021.12
36.4
41.9
CARP
2023.05
32.5
38.5
CARP
2021.12
32.5
38.5
FR+CBR
2023.05
27.2
31.5
FR+CBR
retriever=Fusion Retri...
2021.12
27.2
31.5
IR+CBR
retriever=Iterative Re...
2021.12
16.9
20.9
FR+SBR
retriever=Fusion Retri...
2021.12
13.4
16.2
HYBRIDER
2023.05
9.7
12.8
HYBRIDER
selection=best Top-K
2021.12
9.7
12.8
IR+SBR
retriever=Iterative Re...
2021.12
9.6
13.1
HYBRIDER
selection=Top-1
2021.12
8.4
10.6
Feedback
Search any
task
Search any
task