CORE: Conflict-Oriented Reasoning for General Multimodal Manipulation Detection
About
The rapid rise of generative AI has made multimodal fake news increasingly realistic and pervasive, posing severe threats to public trust and social stability. Existing detection methods rely heavily on manipulation-specific models and large-scale labeled data, resulting in poor generalization to emerging manipulation types. We observed that the essence of manipulated misinformation lies in its intrinsic conflicts, \textbf{i.e.,} semantic or physical inconsistencies either across modalities or with common world knowledge. Inspired by this observation, we propose \textbf{C}onflict-\textbf{O}riented \textbf{RE}asoning (\textbf{CORE}) framework, an effective paradigm that learns to endows multimodal large language models (MLLMs) with explicit conflict-capturing capability. To this end, CORE first constructs the Conflict Attribution Corpus (CAC) with fine-grained annotations of conflict factors and sources, providing essential data support for subsequent conflict perception training. By performing conflict-oriented representation enhancement and reasoning based on CAC, CORE achieves robust and generalizable conflict detection, effectively and rapidly adapting to unseen manipulation types with a few samples or in even zero-shot settings. Extensive experiments demonstrate that CORE surpasses state-of-the-art models. The dataset and code are publicly available at https://github.com/shen8424/CORE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multimodal Manipulation Detection | DGM4 (test) | Accuracy68.4 | 52 | |
| Multimodal Manipulation Detection | MDSM (test) | ACC82 | 52 | |
| Multimodal Manipulation Detection | MMFakeBench (test) | Accuracy79.4 | 52 | |
| Multimodal Manipulation Detection | NewsCLIPpings (test) | Accuracy71 | 52 | |
| Multimodal misinformation detection | MMFakeBench | Accuracy62.6 | 11 | |
| Multimodal Manipulation Detection | DGM4 large-scale | ACC97.14 | 9 | |
| Multimodal Manipulation Detection | MDSM large-scale | Accuracy88.49 | 9 | |
| Multimodal Manipulation Detection | NewsCLIPpings large-scale | Accuracy83.45 | 9 | |
| Multimodal Manipulation Detection | DGM4 | Accuracy65.18 | 9 | |
| Multimodal Manipulation Detection | MDSM | Accuracy88.13 | 9 |