GrOCE:Graph-Guided Online Concept Erasure for Text-to-Image Diffusion Models
About
Concept erasure aims to remove harmful, inappropriate, or copyrighted content from text-to-image diffusion models while preserving non-target semantics. However, existing methods either rely on costly fine-tuning or apply coarse semantic separation, often degrading unrelated concepts and lacking adaptability to evolving concept sets. In this paper, we propose Graph-Guided Online Concept Erasure (GrOCE), a training-free framework that performs precise and context-aware online removal of target concepts. GrOCE constructs dynamic semantic graphs to identify clusters of target concepts and selectively suppress their influence within text prompts. It consists of three synergistic components: (1) dynamic semantic graph construction (Construct) incrementally builds a weighted graph over vocabulary concepts to capture semantic affinities; (2) adaptive cluster identification (Identify) extracts a target concept cluster through multi-hop traversal and diffusion-based scoring to quantify semantic influence; and (3) selective severing (Sever) removes semantic components associated with the target cluster from the text prompt while retaining non-target semantics and the global sentence structure. Extensive experiments demonstrate that GrOCE achieves state-of-the-art performance on the Concept Similarity (CS) and Fr\'echet Inception Distance (FID) metrics, offering efficient, accurate, and stable concept erasure.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Concept Erasure | Instance templates Snoopy erasure | Snoopy Concept Erasure CS16.92 | 6 | |
| Concept Erasure | Instance templates Snoopy & Mickey erasure | Snoopy (CS)16.92 | 6 | |
| Multi-Target Concept Erasure | Violence, Shooting, Pornography, and Hello Kitty prompts Stable Diffusion v1.4 (test) | CS (Violence)19.34 | 6 | |
| Artistic Style Erasure | Artistic Style Templates Target: Picasso | Van Gogh FID0.00e+0 | 5 | |
| Artistic Style Erasure | Artistic Style Templates Target: Monet | Van Gogh FID0.00e+0 | 5 | |
| Concept Erasure | 10-concept erasure workload | Data Preparation Time1.73 | 5 | |
| Artistic Style Erasure | Artistic Style Templates Target: Van Gogh | Van Gogh CS23.28 | 5 | |
| Artistic Style Preservation (Baseline) | Artistic Style Templates v1.0 (test) | -- | 1 |