Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Joint Verification and Reranking for Open Fact Checking Over Tables

About

Structured information is an important knowledge source for automatic verification of factual claims. Nevertheless, the majority of existing research into this task has focused on textual data, and the few recent inquiries into structured data have been for the closed-domain setting where appropriate evidence for each claim is assumed to have already been retrieved. In this paper, we investigate verification over structured data in the open-domain setting, introducing a joint reranking-and-verification model which fuses evidence documents in the verification component. Our open-domain model achieves performance comparable to the closed-domain state-of-the-art on the TabFact dataset, and demonstrates performance gains from the inclusion of multiple tables as well as a significant improvement over a heuristic retrieval baseline.

Michael Schlichtkrull, Vladimir Karpukhin, Barlas O\u{g}uz, Mike Lewis, Wen-tau Yih, Sebastian Riedel• 2020

Related benchmarks

TaskDatasetResultRank
Table Fact VerificationTabFact (test)
Accuracy77.6
98
Table Fact VerificationTabFact small (test)
Accuracy0.794
57
Table Fact VerificationTABFACT complex (test)
Accuracy72.1
39
Table Fact VerificationTABFACT simple (test)
Accuracy88.9
39
Table Fact VerificationTABFACT (val)
Accuracy78.2
21
Showing 5 of 5 rows

Other info

Follow for update