FigStep

Benchmarks

Task Name	Dataset Name	SOTA Result
Safety Evaluation	FigStep	ASR0.6	47
Jailbreak Attack	FigStep	Attack Success Rate (ASR)78.4	26
Safety Evaluation	FigStep (test)	ASR0	24
Large Audio-Language Model Safety Evaluation	Figstep audio	ASR62.8	18
Image-based Jailbreak	FigStep OOD	ASR0	16
Visual Jailbreak Defense	FigStep	ASR0	12
Safety Evaluation	FigStep	DSR100	11
Multimodal Safety Evaluation	FigStep	ASR (%)0.21	9
Jailbreak Detection	FigStep	AUROC0.9955	9
Adversarial Robustness	Figstep audio	ASR6	8
Safety Alignment	FigStep	ASR0.4	8
Jailbreak Attack Robustness	FigStep jailbreak attack	DSR17.44	7
Jailbreak Attack Evaluation	FigStep Average	Average ASR0.053	5

Showing 13 of 13 rows