Backdoor Sentinel: Detecting and Detoxifying Backdoors in Diffusion Models via Temporal Noise Consistency
About
Diffusion models have been widely deployed in AIGC services; however, their reliance on opaque training data and procedures exposes a broad attack surface for backdoor injection. In practical auditing scenarios, due to the protection of intellectual property and commercial confidentiality, auditors are typically unable to access model parameters, rendering existing white-box or query-intensive detection methods impractical. More importantly, even after the backdoor is detected, existing detoxification approaches are often trapped in a dilemma between detoxification effectiveness and generation quality. In this work, we identify a previously unreported phenomenon called temporal noise unconsistency, where the noise predictions between adjacent diffusion timesteps is disrupted in specific temporal segments when the input is triggered, while remaining stable under clean inputs. Leveraging this finding, we propose Temporal Noise Consistency Defense (TNC-Defense), a unified framework for backdoor detection and detoxification. The framework first uses the adjacent timestep noise consistency to design a gray-box detection module, for identifying and locating anomalous diffusion timesteps. Furthermore, the framework uses the identified anomalous timesteps to construct a trigger-agnostic, timestep-aware detoxification module, which directly corrects the backdoor generation path. This effectively suppresses backdoor behavior while significantly reducing detoxification costs. We evaluate the proposed method under five representative backdoor attack scenarios and compare it with state-of-the-art defenses. The results show that TNC-Defense improves the average detection accuracy by $11\%$ with negligible additional overhead, and invalidates an average of $98.5\%$ of triggered samples with only a mild degradation in generation quality.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Backdoor Detoxification | MS-COCO BadT2I_tok | FID (Clean)46.26 | 6 | |
| Backdoor Detoxification | MS-COCO EvilEdit | FID (Clean)60.09 | 6 | |
| Backdoor Detoxification | MS-COCO PersonalBKD_dream | FID (Clean)36.01 | 6 | |
| Backdoor Detoxification | MS-COCO Average across attacks | FID (Clean)47.99 | 6 | |
| Backdoor Detoxification | MS-COCO BadT2I_sent | FID (Clean)49.63 | 6 | |
| Backdoor Detection | MS-COCO BadT2ITok v1.4 (test) | Accuracy93.8 | 5 | |
| Backdoor Detection | MS-COCO BadT2ISent v1.4 (test) | Accuracy91.2 | 5 | |
| Backdoor Detection | MS-COCO EvilEdit v1.4 (test) | Accuracy74.4 | 5 | |
| Backdoor Detection | MS-COCO VillanBKD v1.4 (test) | Accuracy96.2 | 5 | |
| Backdoor Detection | MS-COCO PersonalBKDDream v1.4 (test) | Accuracy74.9 | 5 |