Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Explainable Fake News Detection With Large Language Model via Defense Among Competing Wisdom

About

Most fake news detection methods learn latent feature representations based on neural networks, which makes them black boxes to classify a piece of news without giving any justification. Existing explainable systems generate veracity justifications from investigative journalism, which suffer from debunking delayed and low efficiency. Recent studies simply assume that the justification is equivalent to the majority opinions expressed in the wisdom of crowds. However, the opinions typically contain some inaccurate or biased information since the wisdom of crowds is uncensored. To detect fake news from a sea of diverse, crowded and even competing narratives, in this paper, we propose a novel defense-based explainable fake news detection framework. Specifically, we first propose an evidence extraction module to split the wisdom of crowds into two competing parties and respectively detect salient evidences. To gain concise insights from evidences, we then design a prompt-based module that utilizes a large language model to generate justifications by inferring reasons towards two possible veracities. Finally, we propose a defense-based inference module to determine veracity via modeling the defense among these justifications. Extensive experiments conducted on two real-world benchmarks demonstrate that our proposed method outperforms state-of-the-art baselines in terms of fake news detection and provides high-quality justifications.

Bo Wang, Jing Ma, Hongzhan Lin, Zhiwei Yang, Ruichao Yang, Yuan Tian, Yi Chang• 2024

Related benchmarks

TaskDatasetResultRank
Fake News DetectionPolitiFact
Accuracy89.3
53
Fake News DetectionGossipcop
Accuracy86.2
48
Fake News DetectionWeibo
Accuracy87.5
32
Fact VerificationRAWFC
Precision61.72
30
Veracity PredictionRAWFC (test)
Precision61
28
Early Fake News DetectionPolitiFact-P
Accuracy88
24
Early Fake News DetectionGossipCop-P
Accuracy86.6
24
Fact CheckingLIAR RAW
Precision31.63
20
Veracity PredictionLIAR RAW
Macro Precision31
6
Showing 9 of 9 rows

Other info

Follow for update