Jailbreak Defense on jailbreak defense dataset

0ASR

Gradient-guided Token Masking

Updated 8d ago

Evaluation Results

Method
Gradient-guided Token Masking 2026.05	0	-	-	-	-	-	-	-	-
Gradient-guided Token Masking 2026.05	0	-	-	-	-	-	-	-	-
GUARD 2026.05	0.91	-	-	-	-	-	-	-	-
GUARD 2026.05	0.91	-	-	-	-	-	-	-	-
GUARD 2026.05	0.91	-	-	-	-	-	-	-	-
Gradient-guided Token Masking 2026.05	0.91	-	-	-	-	-	-	-	-
Gradient-guided Token Masking 2026.05	0.91	-	-	-	-	-	-	-	-
GUARD 2026.05	1.82	-	-	-	-	-	-	-	-
ECSO 2026.05	6.36	-	-	-	-	-	-	-	-
ECSO 2026.05	9.09	-	-	-	-	-	-	-	-
ECSO 2026.05	10	-	-	-	-	-	-	-	-
CIDER 2026.05	10.9	-	-	-	-	-	-	-	-
ECSO 2026.05	13.63	-	-	-	-	-	-	-	-
ASTRA 2026.05	13.64	-	-	-	-	-	-	-	-
ASTRA 2026.05	15.45	-	-	-	-	-	-	-	-
CIDER 2026.05	17.27	-	-	-	-	-	-	-	-
ASTRA 2026.05	20	-	-	-	-	-	-	-	-
CIDER 2026.05	20.91	-	-	-	-	-	-	-	-
ASTRA 2026.05	31.81	-	-	-	-	-	-	-	-
W/O DEFENSE 2026.05	68.18	-	-	-	-	-	-	-	-
W/O DEFENSE 2026.05	78.18	-	-	-	-	-	-	-	-
W/O DEFENSE 2026.05	82.73	-	-	-	-	-	-	-	-
CIDER 2026.05	94.55	-	-	-	-	-	-	-	-
W/O DEFENSE 2026.05	97.27	-	-	-	-	-	-	-	-
Llama-3.1-8B-Instruct 2026.04	-	92	48	0	58	75	45	28	49.43
Jailbreak Antidote 2026.04	-	100	97	0	100	86	93	63	77
Surgical 2026.04	-	100	76	61	98	88	90	67	82.86
CAST 2026.04	-	92	51	67	99	81	96	96	83.14
AlphaSteer 2026.04	-	100	96	59	97	89	98	100	91.29
BiPO 2026.04	-	100	100	100	100	94	99	100	99
TruthFlow 2026.04	-	96	90	47	98	86	91	73	83
FineSteer 2026.04	-	100	100	93	100	95	100	99	98.14
Qwen2.5-7B-Instruct 2026.04	-	25	2	1	22	71	19	4	20.57
Jailbreak Antidote 2026.04	-	91	4	26	90	5	41	73	47.14
Surgical 2026.04	-	77	81	67	100	79	88	70	71.71
CAST 2026.04	-	25	27	33	96	91	99	100	67.29
AlphaSteer 2026.04	-	100	100	97	97	95	95	98	97.43
BiPO 2026.04	-	100	100	100	100	99	99	100	99.71
TruthFlow 2026.04	-	99	100	90	100	97	100	99	97.85
FineSteer 2026.04	-	100	100	98	100	97	100	100	99.28