JBB-Behaviors

Benchmarks

Task Name	Dataset Name	SOTA Result
Jailbreak Defense	JBB-Behaviors	ASR0	121
Jailbreak	JBB-Behaviors utilitarian dilemmas (test)	Jailbreak Success Rate87	72
Jailbreak Attack	JBB-Behaviors	Rule-Judge Score100	56
Jailbreaking	JBB Behaviors	ASR100	35
Jailbreak Attack	JBB Behaviors	ASR100	35
Jailbreaking	JBB-Behaviors (test)	ASR (GPT-4o)99	27
Refusal mechanism ablation	JBB-Behaviors 100 harmful prompts (test)	Refusal Rate100	24
Jailbreak Robustness	JBB-Behaviors (test)	ASR0	24
LLM Jailbreaking	JBB-Behaviors Scenario J3	Hypervolume0.707	21
LLM Jailbreaking	JBB-Behaviors Scenario J2	Hypervolume0.691	21
LLM Jailbreaking	JBB-Behaviors Scenario J1	Hypervolume59.1	21
Robustness against priming vulnerability	JBB-Behaviors (test)	ASR (Guardrail Model)0	20
Jailbreak Attack Robustness	JBB-Behaviors	ASR (PAIR)10	18
Jailbreak Robustness	JBB-Behaviors	ASR (PAIR, Guardrail Model)0.3	18
Jailbreak	JBB-Behaviors	ASR (GPT-4o)99.2	12
Jailbreak Attack	JBB-Behaviors GPT-4o	Attack Success Rate (ASR)93	11
Jailbreak Attack	JBB-Behaviors GPT-3.5-Turbo	ASR98	11
Jailbreak Attack	JBB-Behaviors DeepSeek-R1-14B	ASR98	11
Jailbreak Attack	JBB-Behaviors Qwen2.5-14B	ASR98	11
Jailbreak Attack	JBB-Behaviors Llama-3.3-70B	Attack Success Rate (ASR)99	11
Safety Evaluation	JBB-Behaviors	Safety Score99.3	9
Safety Detection	JBB-Behaviors (held-out)	AUROC93.7	5
Safety Evaluation	JBB-Behaviors	Unsafe Interaction Rate0	3
Jailbreak Detection	JBB-Behaviors Benign	Accuracy99.96	1
Jailbreak Detection	JBB-Behaviors Harmful	Accuracy99.94	1

Showing 25 of 25 rows