Noiseprint: a CNN-based camera model fingerprint
About
Forensic analyses of digital images rely heavily on the traces of in-camera and out-camera processes left on the acquired images. Such traces represent a sort of camera fingerprint. If one is able to recover them, by suppressing the high-level scene content and other disturbances, a number of forensic tasks can be easily accomplished. A notable example is the PRNU pattern, which can be regarded as a device fingerprint, and has received great attention in multimedia forensics. In this paper we propose a method to extract a camera model fingerprint, called noiseprint, where the scene content is largely suppressed and model-related artifacts are enhanced. This is obtained by means of a Siamese network, which is trained with pairs of image patches coming from the same (label +1) or different (label -1) cameras. Although noiseprints can be used for a large variety of forensic tasks, here we focus on image forgery localization. Experiments on several datasets widespread in the forensic community show noiseprint-based methods to provide state-of-the-art performance.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Forgery Detection | DSO-1 | AUC82.1 | 25 | |
| Image Forgery Detection | Columbia | AUC0.872 | 25 | |
| Image Forgery Detection | Coverage | AUC0.525 | 25 | |
| Image Manipulation Localization | Coverage | -- | 16 | |
| Image Forgery Detection | NIST16 | AUC0.618 | 15 | |
| Image Forgery Detection | VIPP | AUC0.58 | 15 | |
| Image Forgery Detection | CASIA v1+ | AUC49.4 | 15 | |
| Image Forgery Detection | CocoGlide | AUC52 | 15 | |
| Image Forgery Localization | DSO-1 | F1 (best)0.811 | 14 | |
| Image Forgery Localization | OpenForensics | F1 (best)0.675 | 14 |