Trustworthy Image Authentication using Forensic Knowledge Graphs
About
Advances in generative AI have made image falsification highly realistic, demanding trustworthy authentication systems. Existing forensic detectors can target certain forgery types but lack interpretability, while vision-language models (VLMs) provide explanations but cannot exploit forensic traces for reliable detection. We propose Forensic Knowledge Graphs (FKGs), a unified framework that integrates forensic evidence extraction, structured reasoning, and human-interpretable explanation. Our FKG structure encodes forensic traces along with their causal dependencies and links to scene content. To generate accurate FKGs, we introduce a novel forensic authentication network and an Iterative Context Refinement strategy that guides VLMs to produce faithful, grounded explanations. We also present FKG-50K, a dataset of 50,000 realistic forgeries with ground-truth FKGs. Experiments demonstrate that FKG outperforms both forensic detectors and VLMs in detection, forgery identification and localization, and forensic justification.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| AI-generated image detection | GenImage | -- | 173 | |
| Image Forgery Detection | DSO-1 | AUC96 | 41 | |
| Image Forgery Localization | DSO-1 | F1 Score0.95 | 35 | |
| Fake and manipulated image detection | Synthbuster | Accuracy94 | 25 | |
| Forgery Localization | FKG-50K | AI-Edit F193 | 21 | |
| Forgery Localization | CASIA v2 | F1 Score73 | 21 | |
| Forgery Type Identification | GenImage | Accuracy91 | 17 | |
| Forgery Type Identification | Synthbuster | Accuracy94 | 17 | |
| Forgery Detection | CASIA v2.0 | Accuracy71 | 17 | |
| Forgery Type Identification | FKG-50K | AI-Edit Accuracy81 | 17 |