| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| HarmBench | Cres. | Attack Success Rate (ASR)100 | 624 | 22d ago | |
| AdvBench | EnumAttack | ASR100 | 283 | 1mo ago | |
| HarmBench (test) | GCD | ASRHB100 | 276 | 1mo ago | |
| AdvBench | ArtPrompt | AASR8,712 | 271 | 2mo ago | |
| StrongREJECT | EnumAttack | Attack Success Rate99.4 | 262 | 2mo ago | |
| SafeBench | ArtPrompt | ASR0 | 245 | 2mo ago | |
| JailbreakBench | DictAttack | ASR100 | 242 | 2mo ago | |
| STRONGREJECT (held-out behaviors) | PAIR | ASR (0.5 threshold)100 | 186 | 1mo ago | |
| MaliciousInstruct | PiF | ASR100 | 161 | 4mo ago | |
| HADES | DMN | Attack Success Rate99.6 | 132 | 18d ago | |
| JailbreakBench | ASR@100 | 132 | 4mo ago | ||
| Malicious goals dataset (test) | FigStep | ASR0 | 99 | 4mo ago | |
| SafeBench Tiny | COMET | ASR100 | 94 | 23d ago | |
| MalwareBench | CodeSpear | Attack Success Rate (ASR)81.35 | 82 | 1mo ago | |
| RMCBench | CodeSpear | ASR85.53 | 82 | 1mo ago | |
| JailbreakBench | Crescendo | Attack Success Rate (ASR)0 | 76 | 23d ago | |
| AdvBench (test) | R2J | ASR7,827 | 73 | 4mo ago | |
| Malicious Prompts English (test) | Caesar | ASR@5100 | 72 | 3mo ago | |
| Behaviours | PRO-VICUNA-HUBER | ASR0.9 | 69 | 4mo ago | |
| AdvBench | Attack Success Rate (ASR)0 | 65 | 1mo ago | ||
| Advbench-M | Attack Success Rate (ASR%)0 | 64 | 3mo ago | ||
| StrongREJECT (test) | GCD | Score82.34 | 64 | 1mo ago | |
| Advbench subset | CodeAttack | ASR96 | 64 | 2mo ago | |
| 159 harmful behaviors (test) | CrescendoX | ASR99.37 | 63 | 2mo ago | |
| SorryBench | ChatBug-M | ASR (SorryBench)8.9 | 62 | 26d ago |
