Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Trustworthy Image Authentication using Forensic Knowledge Graphs

About

Advances in generative AI have made image falsification highly realistic, demanding trustworthy authentication systems. Existing forensic detectors can target certain forgery types but lack interpretability, while vision-language models (VLMs) provide explanations but cannot exploit forensic traces for reliable detection. We propose Forensic Knowledge Graphs (FKGs), a unified framework that integrates forensic evidence extraction, structured reasoning, and human-interpretable explanation. Our FKG structure encodes forensic traces along with their causal dependencies and links to scene content. To generate accurate FKGs, we introduce a novel forensic authentication network and an Iterative Context Refinement strategy that guides VLMs to produce faithful, grounded explanations. We also present FKG-50K, a dataset of 50,000 realistic forgeries with ground-truth FKGs. Experiments demonstrate that FKG outperforms both forensic detectors and VLMs in detection, forgery identification and localization, and forensic justification.

Tai D. Nguyen, Matthew C. Stamm• 2026

Related benchmarks

TaskDatasetResultRank
AI-generated image detectionGenImage--
173
Image Forgery DetectionDSO-1
AUC96
41
Image Forgery LocalizationDSO-1
F1 Score0.95
35
Fake and manipulated image detectionSynthbuster
Accuracy94
25
Forgery LocalizationFKG-50K
AI-Edit F193
21
Forgery LocalizationCASIA v2
F1 Score73
21
Forgery Type IdentificationGenImage
Accuracy91
17
Forgery Type IdentificationSynthbuster
Accuracy94
17
Forgery DetectionCASIA v2.0
Accuracy71
17
Forgery Type IdentificationFKG-50K
AI-Edit Accuracy81
17
Showing 10 of 17 rows

Other info

Follow for update