Jailbreak Robustness on HarmBench (Cost & Efficiency Metrics)
0.5AE (Risk/TFLOPs) GCG
Tulu3 SFT
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2026.06 | 0.5 | - | - | 52.4 | 3.5 | 8.9 | 31 | 42 | 50 | |
2026.06 | 0.9 | - | 31.3 | 21.2 | 16.6 | 22.1 | 36 | 98 | 86 | |
2026.06 | 1 | 521.2 | 79.9 | 40.9 | 6 | 10.4 | 52 | 75 | 67 | |
2026.06 | 1 | 503.6 | 72.4 | 25.7 | 6.7 | 18.9 | 54 | 79 | 90 | |
2026.06 | 1.3 | 399.7 | 38.9 | 22.8 | 13.6 | 23 | 73 | 97 | 94 | |
2026.06 | 2.1 | 189 | 44.8 | 24.5 | 7.6 | 16 | 67 | 75 | 83 | |
2026.06 | 3.3 | 173.7 | 33.9 | 13.4 | 15.9 | 36.8 | 81 | 97 | 98 | |
2026.06 | 4.9 | - | - | - | - | - | 15 | - | - | |
2026.06 | 8.4 | 59.3 | 11.2 | 9.2 | 39 | 53.3 | 100 | 100 | 100 | |
2026.06 | 25.6 | 20 | 15.5 | 8.2 | 30.6 | 59.6 | 99 | 99 | 99 |