Detecting GAN generated Fake Images using Co-occurrence Matrices
About
The advent of Generative Adversarial Networks (GANs) has brought about completely novel ways of transforming and manipulating pixels in digital images. GAN based techniques such as Image-to-Image translations, DeepFakes, and other automated methods have become increasingly popular in creating fake images. In this paper, we propose a novel approach to detect GAN generated fake images using a combination of co-occurrence matrices and deep learning. We extract co-occurrence matrices on three color channels in the pixel domain and train a model using a deep convolutional neural network (CNN) framework. Experimental results on two diverse and challenging GAN datasets comprising more than 56,000 images based on unpaired image-to-image translations (cycleGAN [1]) and facial attributes/expressions (StarGAN [2]) show that our approach is promising and achieves more than 99% classification accuracy in both datasets. Further, our approach also generalizes well and achieves good results when trained on one dataset and tested on the other.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Fake Image Detection | UniversalFakeDetect | Guided Score60.5 | 13 | |
| Model Attribution | GM-FFHQ to GM-CelebA-HQ | Accuracy40.4 | 12 | |
| Model Attribution | GM-CelebA (test) | Accuracy61.1 | 12 | |
| Model Attribution | GM-CIFAR10 (test) | Accuracy46.291 | 12 | |
| Model Attribution | GM-CHQ (test) | Accuracy56.3 | 12 | |
| Model Attribution | GM-FFHQ (test) | Accuracy51.3 | 12 | |
| Model Attribution | GM-CIFAR10 to GM-CelebA | Accuracy56.2 | 12 | |
| Model Attribution | GM-CelebA to CIFAR10 | Accuracy46.1 | 12 | |
| Model Attribution | GM-CelebA-HQ to GM-FFHQ | Accuracy42.1 | 12 | |
| Image Manipulation Detection | CycleGAN Facades (test) | AP (%)100 | 9 |