Share your thoughts, 1 month free Claude Pro on usSee more

Jailbreak Robustness on StrongReject (Detailed Attack Metrics)

67Direct Attack Rate

No Defense

Updated 1mo ago

Evaluation Results

Method	Links
No Defense 2025.10		67	86	55	60	80	67	80	-	56	43	76	67
No Defense 2025.10		28	79	44	53	39	60	73	-	59	17	63	51
CAT 2025.10		20	57	36	32	29	0	67	-	65	8	63	38
WildJailbreak 2025.10		6	41	16	22	20	15	11	-	27	7	55	22
WildJailbreak 2025.10		3	41	19	5	7	15	27	-	44	25	46	23
No Defense 2025.10		2	71	31	9	7	57	43	-	66	15	77	38
WildJailbreak 2025.10		2	35	15	14	7	17	19	-	25	16	37	19
LAT 2025.10		2	46	19	6	3	0	41	-	2	2	68	19
Refusal Training 2025.10		0	30	8	3	0	17	28	-	22	4	34	15
PAP Trained 2025.10		0	26	0	5	3	29	23	-	23	7	1	12
CAT 2025.10		0	50	16	4	5	1	37	-	27	5	62	20
CAT* 2025.10		0	21	7	0	0	0	41	-	14	4	43	13
LAT 2025.10		0	39	7	0	0	0	38	-	49	0	37	17
LAT* 2025.10		0	24	2	0	0	0	20	-	11	0	13	7
ASCoT (closed) 2025.10		0	11	2	0	0	10	7	-	9	6	8	5
ASCoT (open) 2025.10		0	11	3	0	1	12	10	-	12	12	8	7
Refusal Training 2025.10		0	60	19	7	2	24	57	-	35	9	43	26
PAP Trained 2025.10		0	58	0	12	12	24	65	-	32	24	1	23
CAT 2025.10		0	14	13	0	0	0	3	-	6	0	71	11
CAT* 2025.10		0	35	10	0	0	5	13	-	27	9	0	10
LAT 2025.10		0	34	17	0	0	0	16	-	1	12	42	12
LAT* 2025.10		0	41	23	3	26	0	0	-	0	6	36	14
ASCoT (closed) 2025.10		0	10	1	0	5	12	36	-	5	12	9	9
ASCoT (open) 2025.10		0	10	2	0	0	11	25	-	40	18	9	12
Refusal Training 2025.10		0	60	20	20	20	24	54	-	42	11	39	30
PAP Trained 2025.10		0	56	0	27	30	23	63	-	50	8	23	28
CAT* 2025.10		0	33	16	3	0	5	31	-	31	6	57	18
LAT* 2025.10		0	53	20	1	1	0	50	-	30	30	71	26
ASCoT (closed) 2025.10		0	15	5	9	18	13	28	-	9	3	7	11
ASCoT (open) 2025.10		0	20	4	26	27	13	26	-	2	6	11	14