MesoNet: a Compact Facial Video Forgery Detection Network
About
This paper presents a method to automatically and efficiently detect face tampering in videos, and particularly focuses on two recent techniques used to generate hyper-realistic forged videos: Deepfake and Face2Face. Traditional image forensics techniques are usually not well suited to videos due to the compression that strongly degrades the data. Thus, this paper follows a deep learning approach and presents two networks, both with a low number of layers to focus on the mesoscopic properties of images. We evaluate those fast networks on both an existing dataset and a dataset we have constituted from online videos. The tests demonstrate a very successful detection rate with more than 98% for Deepfake and 95% for Face2Face.
Darius Afchar, Vincent Nozick, Junichi Yamagishi, Isao Echizen• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Deepfake Detection | DFDC (test) | AUC71.4 | 122 | |
| Deepfake Detection | DFD | AUC0.5906 | 91 | |
| Deepfake Detection | CDFv1, CDFv2, DFD, DFDCP, DFDC (test) | Overall Average Score68.4 | 74 | |
| Face Forgery Detection | DFDCP | Frame-level AUC74.57 | 64 | |
| Face Forgery Detection | DFDC | AUC60.16 | 52 | |
| Fake Face Detection | Celeb-DF v2 (test) | AUC80.52 | 50 | |
| Face Forgery Detection | Celeb-DF | AUC54.8 | 46 | |
| Deepfake Detection | FF++ (test) | AUC84.7 | 44 | |
| Face Forgery Detection | CDF v2 | Frame-level AUC70.02 | 42 | |
| Face Forgery Detection | DFD | Frame-level AUC59.8 | 41 |
Showing 10 of 53 rows