Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Privacy-preserving Adversarial Facial Features

About

Face recognition service providers protect face privacy by extracting compact and discriminative facial features (representations) from images, and storing the facial features for real-time recognition. However, such features can still be exploited to recover the appearance of the original face by building a reconstruction network. Although several privacy-preserving methods have been proposed, the enhancement of face privacy protection is at the expense of accuracy degradation. In this paper, we propose an adversarial features-based face privacy protection (AdvFace) approach to generate privacy-preserving adversarial features, which can disrupt the mapping from adversarial features to facial images to defend against reconstruction attacks. To this end, we design a shadow model which simulates the attackers' behavior to capture the mapping function from facial features to images and generate adversarial latent noise to disrupt the mapping. The adversarial features rather than the original features are stored in the server's database to prevent leaked features from exposing facial information. Moreover, the AdvFace requires no changes to the face recognition network and can be implemented as a privacy-enhancing plugin in deployed face recognition systems. Extensive experimental results demonstrate that AdvFace outperforms the state-of-the-art face privacy-preserving methods in defending against reconstruction attacks while maintaining face recognition accuracy.

Zhibo Wang, He Wang, Shuaifan Jin, Wenwen Zhang, Jiahui Hu, Yan Wang, Peng Sun, Wei Yuan, Kaixin Liu, Kui Ren• 2023

Related benchmarks

TaskDatasetResultRank
Face VerificationCPLFW
Accuracy83.73
188
Face RecognitionCFP-FP
Accuracy92.21
66
Face RecognitionLFW
Accuracy98.45
47
Face RecognitionAgeDB
Accuracy92.57
33
Face RecognitionCALFW
Accuracy93.62
23
Face RecognitionIJB-B
TAR @ FAR=1e-470.21
19
Face RecognitionIJB-C
TAR (FAR=1e-4)74.39
19
Face Representation Storage EfficiencyFace Representation Storage Efficiency
Storage Size5.3
6
Showing 8 of 8 rows

Other info

Follow for update