Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Erased but Not Forgotten: How Backdoors Compromise Concept Erasure

About

The expansion of text-to-image diffusion models has raised concerns about harmful outputs, from fabricated depictions of public figures to sexually explicit imagery. To mitigate such risks, prior work has proposed concept erasure methods that aim to sever unwanted concepts from the model via fine-tuning, yet it remains unclear whether these approaches truly remove all links to the harmful concept or merely conceal superficial connections. In this work, we reveal a critical vulnerability, the Erasure Evasion Backdoor (EEB): an adversary binds a backdoor trigger to a concept slated for removal, and this malicious link survives subsequent erasure. We show that both black-box and white-box adversaries can instantiate this threat. Across six state-of-the-art erasure methods, including robust ones that explicitly search for alternative representations of the target concept, EEB consistently exposes harmful content: up to 82% success against celebrity-identity unlearning, up to 94% for object erasure, and up to 16 times amplification of explicit-content exposure. While EEB uncovers a blind spot in current erasure methods, it also provides a diagnostic tool for stress-testing future concept erasure techniques.

Tobias Braun, Jonas Henry Grebe, Marcus Rohrbach, Anna Rohrbach• 2025

Related benchmarks

TaskDatasetResultRank
Concept ErasureGCD v1.4 (test)
Acc_r93.07
31
Object ErasureCIFAR-10 v1 (test)
Retention Accuracy (Accr)94
31
Concept ErasureI2P
Number of Exposed Body Parts2
30
Concept ErasureSD Celebrity Erasure v2.1 (test)
Accuracy (Retained)88.76
16
Explicit Content ErasureI2P (931 prompts)
Exposed Body-Part Detections252
12
Showing 5 of 5 rows

Other info

Follow for update