Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Attribute-preserving Face Dataset Anonymization via Latent Code Optimization

About

This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anonymized counterparts, the preservation of which is of paramount importance for their use in downstream tasks. We accordingly present a task-agnostic anonymization procedure that directly optimizes the images' latent representation in the latent space of a pre-trained GAN. By optimizing the latent codes directly, we ensure both that the identity is of a desired distance away from the original (with an identity obfuscation loss), whilst preserving the facial attributes (using a novel feature-matching loss in FaRL's deep feature space). We demonstrate through a series of both qualitative and quantitative experiments that our method is capable of anonymizing the identity of the images whilst -- crucially -- better-preserving the facial attributes. We make the code and the pre-trained models publicly available at: https://github.com/chi0tzp/FALCO.

Simone Barattin, Christos Tzelepis, Ioannis Patras, Nicu Sebe• 2023

Related benchmarks

TaskDatasetResultRank
Face Forgery DetectionDFDCP
Frame-level AUC62.32
64
Face Forgery DetectionDFDC
AUC58.54
52
Face Forgery DetectionCDF v2
Frame-level AUC65.41
42
Face Forgery DetectionDFD
Frame-level AUC59.49
41
Face AnonymizationCelebA-HQ official (test)
ReID Score6.7
40
Face Forgery DetectionCDF v1
Frame-level AUC0.6912
40
Face Forgery DetectionFaceShifter HQ (FSh)
Video-level AUC54.98
37
Face Forgery DetectionCross Domain Evaluation Summary
Average AUC60.13
27
Face Forgery DetectionUADFV
AUC60.48
27
Face AnonymizationCelebA-HQ
FID (ImageNet)26.59
9
Showing 10 of 22 rows

Other info

Code

Follow for update