Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

OTT-QA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Open Table-and-Text Question AnsweringOTT-QA 1.0 (dev)
EM56.9
27
Question AnsweringOTT-QA (test)
EM54.9
14
Open Table-and-Text Question AnsweringOTT-QA 1.0 (test)
EM43
10
Table-Text RetrievalOTT-QA (dev)
Table Recall R@157.6
8
Question AnsweringOTT-QA (dev)
EM40
8
End-to-end Question AnsweringOTT-QA
Accuracy0.317
6
Multi-hop Question AnsweringOTT-QA full (val)
EM56.9
5
RetrievalOTT-QA
Precision47.3
3
RetrievalOTT-QA (dev)
Top-20 Acc80.5
3
Multi-hop Question AnsweringOTT-QA sampled 500 questions (val)
EM48.8
1
Showing 10 of 10 rows