Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Detecting GAN generated Fake Images using Co-occurrence Matrices

About

The advent of Generative Adversarial Networks (GANs) has brought about completely novel ways of transforming and manipulating pixels in digital images. GAN based techniques such as Image-to-Image translations, DeepFakes, and other automated methods have become increasingly popular in creating fake images. In this paper, we propose a novel approach to detect GAN generated fake images using a combination of co-occurrence matrices and deep learning. We extract co-occurrence matrices on three color channels in the pixel domain and train a model using a deep convolutional neural network (CNN) framework. Experimental results on two diverse and challenging GAN datasets comprising more than 56,000 images based on unpaired image-to-image translations (cycleGAN [1]) and facial attributes/expressions (StarGAN [2]) show that our approach is promising and achieves more than 99% classification accuracy in both datasets. Further, our approach also generalizes well and achieves good results when trained on one dataset and tested on the other.

Lakshmanan Nataraj, Tajuddin Manhar Mohammed, Shivkumar Chandrasekaran, Arjuna Flenner, Jawadul H. Bappy, Amit K. Roy-Chowdhury, B. S. Manjunath• 2019

Related benchmarks

TaskDatasetResultRank
Fake Image DetectionUniversalFakeDetect (test)
Mean Accuracy66.9
40
AI-generated image detectionUniversalFakeDetect
Pro-GAN Accuracy97.7
32
Fake Image DetectionUniversalFakeDetect
mAcc68.8
14
Model AttributionGM-FFHQ to GM-CelebA-HQ
Accuracy40.4
12
Model AttributionGM-CelebA (test)
Accuracy61.1
12
Model AttributionGM-CIFAR10 (test)
Accuracy46.291
12
Model AttributionGM-CHQ (test)
Accuracy56.3
12
Model AttributionGM-FFHQ (test)
Accuracy51.3
12
Model AttributionGM-CIFAR10 to GM-CelebA
Accuracy56.2
12
Model AttributionGM-CelebA to CIFAR10
Accuracy46.1
12
Showing 10 of 14 rows

Other info

Follow for update