Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

High-Fidelity Face Content Recovery via Tamper-Resilient Versatile Watermarking

About

The proliferation of AIGC-driven face manipulation and deepfakes poses severe threats to media provenance, integrity, and copyright protection. Prior versatile watermarking systems typically rely on embedding explicit localization payloads, which introduces a fidelity--functionality trade-off: larger localization signals degrade visual quality and often reduce decoding robustness under strong generative edits. Moreover, existing methods rarely support content recovery, limiting their forensic value when original evidence must be reconstructed. To address these challenges, we present VeriFi, a versatile watermarking framework that unifies copyright protection, pixel-level manipulation localization, and high-fidelity face content recovery. VeriFi makes three key contributions: (1) it embeds a compact semantic latent watermark that serves as an content-preserving prior, enabling faithful restoration even after severe manipulations; (2) it achieves fine-grained localization without embedding localization-specific artifacts by correlating image features with decoded provenance signals; and (3) it introduces an AIGC attack simulator that combines latent-space mixing with seamless blending to improve robustness to realistic deepfake pipelines. Extensive experiments on CelebA-HQ and FFHQ show that VeriFi consistently outperforms strong baselines in watermark robustness, localization accuracy, and recovery quality, providing a practical and verifiable defense for deepfake forensics.

Peipeng Yu, Jinfeng Xie, Chengfu Ou, Xiaoyu Zhou, Jianwei Fei, Yunshu Dai, Zhihua Xia, Chip Hong Chang• 2026

Related benchmarks

TaskDatasetResultRank
Image Quality EvaluationCelebA-HQ
PSNR42.53
25
Face recovery (SD Inpainting)CelebA-HQ
PSNR (Rec)31.06
12
Tamper LocalizationCelebA-HQ SD Inpainting (1,000 images)
F1 Score94.6
11
Tamper LocalizationCelebA-HQ HD-painter
F1 Score97.5
11
Tamper LocalizationCelebA-HQ Splicing (1,000 images)
F1 Score98.9
11
Watermark ExtractionCelebA-HQ
InfoSwap Robustness99.6
9
Face recovery (SD Inpainting)FFHQ
PSNR (Rec)30.61
6
Face InpaintingCelebA-HQ
PSNR28.34
6
Face recovery (HD-painter)FFHQ
PSNRrec26.84
3
Face recovery (InfoSwap)FFHQ
PSNRrec24.25
3
Showing 10 of 13 rows

Other info

Follow for update