Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks

About

Deepfake facial manipulation has garnered significant public attention due to its impacts on enhancing human experiences and posing privacy threats. Despite numerous passive algorithms that have been attempted to thwart malicious Deepfake attacks, they mostly struggle with the generalizability challenge when confronted with hyper-realistic synthetic facial images. To tackle the problem, this paper proposes a proactive Deepfake detection approach by introducing a novel training-free landmark perceptual watermark, LampMark for short. We first analyze the structure-sensitive characteristics of Deepfake manipulations and devise a secure and confidential transformation pipeline from the structural representations, i.e. facial landmarks, to binary landmark perceptual watermarks. Subsequently, we present an end-to-end watermarking framework that imperceptibly and robustly embeds and extracts watermarks concerning the images to be protected. Relying on promising watermark recovery accuracies, Deepfake detection is accomplished by assessing the consistency between the content-matched landmark perceptual watermark and the robustly recovered watermark of the suspect image. Experimental results demonstrate the superior performance of our approach in watermark recovery and Deepfake detection compared to state-of-the-art methods across in-dataset, cross-dataset, and cross-manipulation scenarios.

Tianyi Wang, Mengxiao Huang, Harry Cheng, Xiao Zhang, Zhiqi Shen• 2024

Related benchmarks

TaskDatasetResultRank
Image Quality EvaluationCelebA-HQ
PSNR44.05
25
Watermarked Image Quality EvaluationCelebA-HQ
PSNR44.6251
14
Watermark RecoveryCelebA-HQ 128x128 resolution (test)
Jpeg Test BER0.00e+0
10
Watermark ExtractionCelebA-HQ
InfoSwap Robustness89.21
9
Watermark RecoveryCelebA-HQ
JpegTest BER0.00e+0
8
Showing 5 of 5 rows

Other info

Follow for update