Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unified Concept Editing in Diffusion Models

About

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However, in the real world, all of these issues appear simultaneously in the same model. We present a method that tackles all issues with a single approach. Our method, Unified Concept Editing (UCE), edits the model without training using a closed-form solution, and scales seamlessly to concurrent edits on text-conditional diffusion models. We demonstrate scalable simultaneous debiasing, style erasure, and content moderation by editing text-to-image projections, and we present extensive experiments demonstrating improved efficacy and scalability over prior work. Our code is available at https://unified.baulab.info

Rohit Gandikota, Hadas Orgad, Yonatan Belinkov, Joanna Materzy\'nska, David Bau• 2023

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationMS-COCO (val)
FID41.55
112
Text-to-Image GenerationMS-COCO
FID18.51
75
Continual Concept Learning10 Sequential Concepts (test)
UA100
70
Text-to-Image GenerationCOCO
FID77.41
51
Text-to-Image GenerationMS-COCO 30k (val)
FID14.04
42
Text-to-Image GenerationMSCOCO 30K
FID77.72
42
Concept UnlearningUnlearnDiffAtk
UnlearnDiffAtk0.3521
36
Explicit Content RemovalI2P
Armpits Count29
28
Safe Text-to-Image GenerationCoPro V2 (test)
IP33
23
Safe Text-to-Image GenerationUnsafe Diffusion (UD)
IP Score38
23
Showing 10 of 119 rows
...

Other info

Follow for update