Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videos

About

Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained from a social network. Although numerous methods have been developed for detecting forged images and videos, they are generally targeted at certain domains and quickly become obsolete as new kinds of attacks appear. The method introduced in this paper uses a capsule network to detect various kinds of spoofs, from replay attacks using printed images or recorded videos to computer-generated videos using deep convolutional neural networks. It extends the application of capsule networks beyond their original intention to the solving of inverse graphics problems.

Huy H. Nguyen, Junichi Yamagishi, Isao Echizen• 2018

Related benchmarks

TaskDatasetResultRank
Deepfake DetectionDFD
AUC0.684
77
Artifact DetectionOpenMMSec
Deepfake EFS67.7
68
Face Forgery DetectionCeleb-DF
AUC57.5
46
Deepfake DetectionCDFv1, CDFv2, DFD, DFDCP, DFDC (test)
DFD Score68.4
42
Deepfake DetectionCelebDF v2
AUC0.747
40
Deepfake DetectionFF++ (test)
AUC96.6
39
Deepfake DetectionFF++
AUC96.6
34
Deepfake DetectionCross-Domain Evaluation (test)
CDFv1 Score79.09
31
Deepfake DetectionFaceForensics++ c23 (train)
FF c23 Score84.21
31
Deepfake DetectionCelebDF (test)
AUC0.575
30
Showing 10 of 25 rows

Other info

Follow for update