Jailbreak

Benchmarks

Dataset Name	SOTA Method	Metric
AdvBench	LATS	Avg Queries2.1	119	1mo ago
JBB-Behaviors utilitarian dilemmas (test)	TRIAL	Jailbreak Success Rate87	72	3mo ago
JBB		Jailbreak Rate0	70	4mo ago
Sorry	Abliteration	Jailbreak Rate99.8	70	4mo ago
AdvBench (Intra-episode)	AutoDAN (loss)	ASR100	64	1mo ago
HarmBench	FigStep	Toxicity Score1.01	50	2mo ago
HarmBench Standard Behaviours (200 examples)	AutoDan	ASR0	48	4mo ago
Jailbreak scenario	LLM.int8()	ASR (Jailbreak Scenario)95.7	42	2mo ago
WildJailBreak (WJB) (test)	Jailbreak-R1	ASR@12	33	2mo ago
JailbreakBench (original split)	TRACE (single)	ASR@195.15	33	2mo ago
HarmBench (HB) (standard split)	TRACE (mix)	ASR@190.57	33	2mo ago
AdvBench Ensemble configuration GPT-4o	ArtPrompt	Attack Success Rate (ASR)0	25	4mo ago
Jailbreak		MMLU65.5	20	4mo ago
Malicious-Educator	H-CoT	Attack Success Rate (ASR)80	18	2mo ago
AdvBench (test)	ReNeLLM	ASR (GPT-3.5 Turbo)91.35	16	2mo ago
AdvBench Ensemble configuration Average	ArtPrompt	Harmfulness Score (HS)1.43	15	4mo ago
AdvBench Ensemble configuration Llama-3-70B	SATA-MLM	Harmfulness Score (HS)4.6	15	4mo ago
AdvBench Ensemble configuration Claude-v2	ArtPrompt	Harmfulness Score (HS)1.08	15	4mo ago
Advbench-M Image + Text (test)	JOOD	HF (BE)980	13	4mo ago
StrongReject	HMNS	ASR (GPT-4o)96.1	12	3mo ago
JBB-Behaviors	HMNS	ASR (GPT-4o)99.2	12	3mo ago
AdvBench	HMNS	ASR (GPT-4o)99.1	12	3mo ago
AdvBench 50 most harmful requests	MIDAS	Attack Success Rate (ASR)95.83	12	4mo ago
AdvBench	CodeChameleon	GPT-4o Jailbreak Success Rate94.4	11	1mo ago
AdvBench, HarmBench, and StrongReject	AGR	Time per Successful Attack (s)10.8	7	2mo ago

Showing 25 of 37 rows