SOTA Attack Success Rate benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
HEx-PHI	DataShield	Attack Success Rate0	63	1mo ago
DirectHarm4		Attack Success Rate85.86	54	1mo ago
InjecAgent	Llama-4	Attack Success Rate (ASR)88.3	32	3mo ago
20,000 harmful requests and 20,000 jailbreak prompts (test)	GateBreaker	Attack Success Rate (ASR)80.2	18	4mo ago
CTCC fingerprinting scenario b	CTCC-LLaMA2-7B	SVA100	18	4mo ago
PandaGPT Image Modality	asymmetric cross-modal backdoor attack	Exact ASR99.5	8	2mo ago
SALAD-Bench Heavy Blur	GPT-4o	Attack Success Rate (ASR)0	8	2mo ago
SALAD-Bench Triple Deg.	GPT-4o	Attack Success Rate (ASR)0	8	2mo ago
SALAD-Bench 8px	GPT-4o	ASR0	8	2mo ago
SALAD-Bench 6px	GPT-4o	ASR0	8	2mo ago
SALAD-Bench Rot 90°	GPT-4o	ASR0	8	2mo ago
Alpaca	DIM	ASR (Alpaca)0	8	3mo ago
AgentDojo Slack environment		IA Success Rate0	8	4mo ago
GeNIS (All shards)		ASR100	6	1mo ago
NQ	PoisonedRAG	ASR49.1	6	4mo ago
GeNIS (Infected shard only)		ASR100	4	1mo ago
IoT-23 Infected shard only		ASR100	4	1mo ago
IoT-23 All shards	XGB-FU	ASR6.1692	4	1mo ago
CIRR (test)	TGB	R@198.63	4	3mo ago
SVHN (test)		Clean Success Rate0	4	4mo ago
PandaGPT Text Modality	asymmetric cross-modal backdoor attack	Exact ASR99.4	3	2mo ago
PandaGPT Audio Modality	asymmetric cross-modal backdoor attack	Exact ASR99.2	3	2mo ago
IoT-23 Retraining scope		ASR6.1218	2	1mo ago

Showing 23 of 23 rows