Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Open Table-and-Text Question Answering on OTT-QA 1.0 (test)
Loading...
43
EM
Oracle Table + Link (w/o Retrieval) + HYBRIDER
2.856
13.278
23.7
34.122
Oct 20, 2020
EM
F1
Updated 4d ago
Evaluation Results
Method
Method
Links
EM
F1
Oracle Table + Link (w/o Retrieval) + HYBRIDER
Retriever Setting=Best...
2020.10
43
49.8
Oracle Link + Fusion-Retrieval + Cross-Block Reader
Retriever Setting=Best...
2020.10
35
39.5
Fusion-Retrieval + Cross-Block Reader
Retriever Setting=Best
2020.10
27.2
31.5
Iterative-Retrieval + Cross-Block Reader
Retriever Setting=Best
2020.10
16.9
20.9
Fusion-Retrieval + Single-Block Reader
Retriever Setting=Best
2020.10
13.4
16.9
HYBRIDER (best Top-K)
Retriever Setting=Best
2020.10
9.7
12.8
Iterative-Retrieval + Single-Block Reader
Retriever Setting=Best
2020.10
9.6
13.1
Text-only Retrieval + Cross-Block Reader
Retriever Setting=Best...
2020.10
8.8
12.1
HYBRIDER (Top-1)
Retriever Setting=Best
2020.10
8.4
10.6
Table-only Retrieval + Cross-Block Reader
Retriever Setting=Best...
2020.10
4.4
7
Feedback
Search any
task
Search any
task