Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DeClarE: Debunking Fake News and False Claims using Evidence-Aware Deep Learning

About

Misinformation such as fake news is one of the big challenges of our society. Research on automated fact-checking has proposed methods based on supervised learning, but these approaches do not consider external evidence apart from labeled training instances. Recent approaches counter this deficit by considering external sources related to a claim. However, these methods require substantial feature modeling and rich lexicons. This paper overcomes these limitations of prior work with an end-to-end model for evidence-aware credibility assessment of arbitrary textual claims, without any human intervention. It presents a neural network model that judiciously aggregates signals from external evidence articles, the language of these articles and the trustworthiness of their sources. It also derives informative features for generating user-comprehensible explanations that makes the neural network predictions transparent to the end-user. Experiments with four datasets and ablation studies show the strength of our method.

Kashyap Popat, Subhabrata Mukherjee, Andrew Yates, Gerhard Weikum• 2018

Related benchmarks

TaskDatasetResultRank
Fake News DetectionPolitiFact
Accuracy47.22
53
Fake News DetectionGossipcop
Accuracy50.64
48
Veracity PredictionRAWFC (test)
Precision43.4
28
Veracity PredictionLIAR-RAW (test)
Precision22.86
12
Claim VerificationLIAR (test)
Precision22.9
12
Misinformation DetectionCoAID
Accuracy89.98
12
Misinformation DetectionHorne 2017
Accuracy62.5
12
Claim VerificationSnopes
Micro F10.762
6
Claim VerificationPolitiFact
Micro F147.5
6
Showing 9 of 9 rows

Other info

Follow for update