Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection

About

Multimodal misinformation poses an escalating challenge that often evades traditional detectors, which are opaque black boxes and fragile against new manipulation tactics. We present Probabilistic Concept Graph Reasoning (PCGR), an interpretable and evolvable framework that reframes multimodal misinformation detection (MMD) as structured and concept-based reasoning. PCGR follows a build-then-infer paradigm, which first constructs a graph of human-understandable concept nodes, including novel high-level concepts automatically discovered and validated by multimodal large language models (MLLMs), and then applies hierarchical attention over this concept graph to infer claim veracity. This design produces interpretable reasoning chains linking evidence to conclusions. Experiments demonstrate that PCGR achieves state-of-the-art MMD accuracy and robustness to emerging manipulation types, outperforming prior methods in both coarse detection and fine-grained manipulation recognition.

Ruichao Yang, Wei Gao, Xiaobin Zhu, Jing Ma, Hongzhan Lin, Ziyang Luo, Bo-Wen Zhang, Xu-Cheng Yin• 2026

Related benchmarks

TaskDatasetResultRank
Coarse-level Multimodal Misinformation DetectionMiRAGe News
Accuracy80.2
14
Coarse-level Multimodal Misinformation DetectionMMFakeBench
Accuracy80.6
14
Coarse-level Multimodal Misinformation DetectionAMG
Accuracy84.3
14
Fine-grained Manipulation DetectionMMFakeBench (test)
Mic-F168.6
7
Fine-grained Manipulation DetectionAMG (test)
Mic-F175.6
7
Showing 5 of 5 rows

Other info

Follow for update