Two-Stream Neural Networks for Tampered Face Detection
About
We propose a two-stream network for face tampering detection. We train GoogLeNet to detect tampering artifacts in a face classification stream, and train a patch based triplet network to leverage features capturing local noise residuals and camera characteristics as a second stream. In addition, we use two different online face swapping applications to create a new dataset that consists of 2010 tampered images, each of which contains a tampered face. We evaluate the proposed two-stream network on our newly collected dataset. Experimental results demonstrate the effectiveness of our method.
Peng Zhou, Xintong Han, Vlad I. Morariu, Larry S. Davis• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Face Forgery Detection | Celeb-DF | AUC53.8 | 46 | |
| Deepfake Detection | FF++ (test) | AUC70.1 | 39 | |
| Deepfake Detection | CelebDF (test) | AUC0.538 | 30 | |
| Face Forgery Detection | FaceForensics++ | AUC70.1 | 20 | |
| Deepfake Detection | DeepfakeTIMIT LQ | AUC83.5 | 19 | |
| Deepfake Detection | DeepfakeTIMIT HQ | AUC0.735 | 19 |
Showing 6 of 6 rows