Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Context-Aware Full Body Anonymization using Text-to-Image Diffusion Models

About

Anonymization plays a key role in protecting sensible information of individuals in real world datasets. Self-driving cars for example need high resolution facial features to track people and their viewing direction to predict future behaviour and react accordingly. In order to protect people's privacy whilst keeping important features in the dataset, it is important to replace the full body of a person with a highly detailed anonymized one. In contrast to doing face anonymization, full body replacement decreases the ability of recognizing people by their hairstyle or clothes. In this paper, we propose a workflow for full body person anonymization utilizing Stable Diffusion as a generative backend. Text-to-image diffusion models, like Stable Diffusion, OpenAI's DALL-E or Midjourney, have become very popular in recent time, being able to create photorealistic images from a single text prompt. We show that our method outperforms state-of-the art anonymization pipelines with respect to image quality, resolution, Inception Score (IS) and Frechet Inception Distance (FID). Additionally, our method is invariant with respect to the image generator and thus able to be used with the latest models available.

Pascal Zwick, Kevin Roesch, Marvin Klemp, Oliver Bringmann• 2024

Related benchmarks

TaskDatasetResultRank
Person Re-IdentificationCCVID Clothes-Changing
R-186.4
40
Video Question AnsweringNExT-QA zero-shot
Accuracy0.7649
28
Video Question AnsweringHOIGen zero-shot
Accuracy83.33
11
Video Question AnsweringMedVideoCap zero-shot
Accuracy (%)86.3
11
Privacy EvaluationHOI-Gen1M
Identity Similarity7.28
10
Video Quality EvaluationHOIGen 1M (test)
Subject Consistency88.19
10
Body Re-identificationCCVID Standard (SC)
R-196.2
9
Showing 7 of 7 rows

Other info

Follow for update