Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

KG-CRAFT: Knowledge Graph-based Contrastive Reasoning with LLMs for Enhancing Automated Fact-checking

About

Claim verification is a core component of automated fact-checking systems, aimed at determining the truthfulness of a statement by assessing it against reliable evidence sources such as documents or knowledge bases. This work presents KG-CRAFT, a method that improves automatic claim verification by leveraging large language models (LLMs) augmented with contrastive questions grounded in a knowledge graph. KG-CRAFT first constructs a knowledge graph from claims and associated reports, then formulates contextually relevant contrastive questions based on the knowledge graph structure. These questions guide the distillation of evidence-based reports, which are synthesised into a concise summary that is used for veracity assessment by LLMs. Extensive evaluations on two real-world datasets (LIAR-RAW and RAWFC) demonstrate that our method achieves a new state-of-the-art in predictive performance. Comprehensive analyses validate in detail the effectiveness of our knowledge graph-based contrastive reasoning approach in improving LLMs' fact-checking capabilities.

V\'itor N. Louren\c{c}o, Aline Paes, Tillman Weyde, Audrey Depeige, Mohnish Dubey• 2026

Related benchmarks

TaskDatasetResultRank
Fact VerificationRAWFC
Precision81.63
30
Fact CheckingPubHealth
Balanced Accuracy78.66
26
Fact CheckingLIAR RAW
Precision77.38
20
Scientific Fact VerificationSciFact
Macro F183.03
16
Showing 4 of 4 rows

Other info

Follow for update