Ring-a-bell
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Safety Unlearning Evaluation | Ring-A-Bell Violence (test) | ASR5.54 | 21 | |
| Safety Unlearning Evaluation | Ring-A-Bell Nudity (test) | ASR9.22 | 21 | |
| Concept Unlearning | Ring-A-Bell | Ring-A-Bell Score0.83 | 20 | |
| NSFW suppression | Ring-A-Bell | ASR1.3 | 18 | |
| Adversarial Robustness in Concept Erasing | Ring-A-Bell K-16, K-38, K-77 | K-16 Score0.9579 | 14 | |
| Safety Evaluation | Ring-A-Bell | Ring-16 Score4.93 | 13 | |
| Safe Text-to-Image Generation | Ring-A-Bell | ASR83.1 | 13 | |
| Nudity Concept Erasure | Ring-a-bell Adversarial Prompts | Erase Rate (%)100 | 13 | |
| Concept Unlearning Robustness | Ring-A-Bell adversarial prompts (K77) | ASR (Threshold 0.3)1.05 | 10 | |
| Concept Unlearning Robustness | Ring-A-Bell adversarial prompts K38 | ASR (T=0.3)1.05 | 10 | |
| Concept Unlearning Robustness | Ring-A-Bell adversarial prompts (K16) | ASR (T=0.3)71.58 | 10 | |
| Safe generation against nudity prompts | Ring-A-Bell | Attack Success Rate (ASR)5.1 | 9 | |
| Concept Erasure Robustness | Ring-A-Bell Union | Nudity Rate24.77 | 9 | |
| Concept Erasure Robustness | Ring-A-Bell | Nudity Rate11.01 | 9 | |
| Implicit Concept Erasure | Ring-A-Bell | ASR39 | 9 | |
| Adversarial Robustness | Ring-A-Bell | Unsafe Ratio27 | 8 | |
| Concept Erasure | Ring-A-Bell | ASR83.1 | 8 | |
| Video Nudity Erasure | Ring-A-Bell | Nudity Rate6.97 | 6 | |
| Concept Erasure | Ring-A-Bell (285 prompts) | Attack Success Rate (w/o ATTACK)83.15 | 5 | |
| Nudity revival | Ring-A-Bell 101 prompts | Detected NSFW Image Count101 | 5 | |
| Concept Erasure | Ring-A-Bell (Ring77) | ASR95.8 | 5 | |
| Concept Erasure | Ring-A-Bell Ring38 | ASR94.7 | 5 | |
| Concept Erasure | Ring-A-Bell Ring16 | ASR97.9 | 5 | |
| Safe Image Generation | Ring-A-Bell violence | DSR62.44 | 4 | |
| NSFW Removal | Ring-a-Bell | Ring-a-Bell Score97.72 | 4 |
Showing 25 of 27 rows