Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Is LLMs Hallucination Usable? LLM-based Negative Reasoning for Fake News Detection

About

The questionable responses caused by knowledge hallucination may lead to LLMs' unstable ability in decision-making. However, it has never been investigated whether the LLMs' hallucination is possibly usable to generate negative reasoning for facilitating the detection of fake news. This study proposes a novel supervised self-reinforced reasoning rectification approach - SR$^3$ that yields both common reasonable reasoning and wrong understandings (negative reasoning) for news via LLMs reflection for semantic consistency learning. Upon that, we construct a negative reasoning-based news learning model called - \emph{NRFE}, which leverages positive or negative news-reasoning pairs for learning the semantic consistency between them. To avoid the impact of label-implicated reasoning, we deploy a student model - \emph{NRFE-D} that only takes news content as input to inspect the performance of our method by distilling the knowledge from \emph{NRFE}. The experimental results verified on three popular fake news datasets demonstrate the superiority of our method compared with three kinds of baselines including prompting on LLMs, fine-tuning on pre-trained SLMs, and other representative fake news detection methods.

Chaowei Zhang, Zongling Feng, Zewei Zhang, Jipeng Qiang, Guandong Xu, Yun Li• 2025

Related benchmarks

TaskDatasetResultRank
Fake News DetectionWeibo
Accuracy94.5
37
Clickbait DetectionNC-Clickbait
Accuracy69.84
14
Clickbait DetectionDL-Clickbait
Accuracy91.43
14
Clickbait DetectionCD-Clickbait
Accuracy85.45
14
Fake News DetectionFineFake
Accuracy79.9
5
Showing 5 of 5 rows

Other info

Follow for update