Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MUSER: A MUlti-Step Evidence Retrieval Enhancement Framework for Fake News Detection

About

The ease of spreading false information online enables individuals with malicious intent to manipulate public opinion and destabilize social stability. Recently, fake news detection based on evidence retrieval has gained popularity in an effort to identify fake news reliably and reduce its impact. Evidence retrieval-based methods can improve the reliability of fake news detection by computing the textual consistency between the evidence and the claim in the news. In this paper, we propose a framework for fake news detection based on MUlti-Step Evidence Retrieval enhancement (MUSER), which simulates the steps of human beings in the process of reading news, summarizing, consulting materials, and inferring whether the news is true or fake. Our model can explicitly model dependencies among multiple pieces of evidence, and perform multi-step associations for the evidence required for news verification through multi-step retrieval. In addition, our model is able to automatically collect existing evidence through paragraph retrieval and key evidence selection, which can save the tedious process of manual evidence collection. We conducted extensive experiments on real-world datasets in different languages, and the results demonstrate that our proposed model outperforms state-of-the-art baseline methods for detecting fake news by at least 3% in F1-Macro and 4% in F1-Micro. Furthermore, it provides interpretable evidence for end users.

Hao Liao, Jiaohao Peng, Zhanyi Huang, Wei Zhang, Guanghua Li, Kai Shu, Xing Xie• 2023

Related benchmarks

TaskDatasetResultRank
Veracity PredictionLIAR RAW
Macro Precision27.8
24
Veracity PredictionRAWFC
Precision47.47
18
Fact CheckingPolitiFact
Real F1 Score75
15
Clickbait DetectionNC-Clickbait
Accuracy68.5
14
Clickbait DetectionDL-Clickbait
Accuracy90.89
14
Clickbait DetectionCD-Clickbait
Accuracy85.32
14
Showing 6 of 6 rows

Other info

Follow for update