Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization

About

Anonymizing human-centric video data is an understudied problem. Prior anonymization techniques either blur or redact pixels at the cost of realism and downstream utility, or generate frame-by-frame at the cost of temporal coherence. We introduce ReGenHuman, the first full-body video anonymization pipeline that is simultaneously realistic, temporally consistent, and anonymous by construction. Contrary to past approaches which redact or edit the inputs directly, we propose a regenerate, don't edit paradigm. Our approach composites 2D pose, segmentation, and monocular depth into two complementary conditioning streams - StructAll and StructHuman, which are used to fine-tune a video-to-video diffusion backbone on in-the-wild human videos, synthesizing the human regions entirely from identity-free structural cues. We evaluate our model on privacy, quality, and utility, and show that our ReGenHuman achieves the best tradeoff across all three axes against current baselines. We further show that our anonymized videos remain effective for downstream tasks, including video question answering.

Adam Sun, Eshaan Barkataki, Arnold Milstein, Gordon Wetzstein, Ehsan Adeli• 2026

Related benchmarks

TaskDatasetResultRank
Person Re-IdentificationCCVID Clothes-Changing
R-11.4
40
Video Question AnsweringNExT-QA zero-shot
Accuracy0.7585
28
Video Question AnsweringHOIGen zero-shot
Accuracy82.37
11
Video Question AnsweringMedVideoCap zero-shot
Accuracy (%)85.2
11
Video Quality EvaluationHOIGen 1M (test)
Subject Consistency92.88
10
Privacy EvaluationHOI-Gen1M
Identity Similarity0.92
10
Body Re-identificationCCVID Standard (SC)
R-13.2
9
Showing 7 of 7 rows

Other info

Follow for update