Attack Success Rate Evaluation

Benchmarks

Dataset Name	SOTA Method	Metric
SKILL-INJECT Contextual		Attack Success Rate (ASR)0	30	11d ago
SKILL-INJECT Obvious	SkillAttack	ASR93	30	11d ago
Hot100	SkillAttack	ASR26	20	11d ago
40 diverse smartphone tasks Total	HG-IDA*	Target Attack Success Rate (Tasr)95.8	16	9d ago
40 diverse smartphone tasks Persuade subcategory	HG-IDA*	Target ASR100	16	9d ago
40 diverse smartphone tasks Generate subcategory	HG-IDA*	Target ASR75	16	9d ago
40 diverse smartphone tasks Execute	HG-IDA*	TASR100	16	9d ago
MMDS MMRT (test)	Qwen2.5-VL-72B-Instruct	ASR100	7	1mo ago
HRL/LRL Safety Prompts English Multi-Image v1		ASR2	6	1mo ago
HRL/LRL Safety Prompts Tamil Multi-Image v1		ASR0	6	1mo ago
HRL/LRL Safety Prompts Welsh Multi-Image v1		ASR0	6	1mo ago
HRL/LRL Safety Prompts English, Single Image v1		ASR0	6	1mo ago
HRL LRL Safety Prompts Tamil Single Image v1		ASR0	6	1mo ago
HRL/LRL Safety Prompts Welsh Single Image v1		ASR6	6	1mo ago
HRL/LRL Safety Prompts English Text v1		ASR1	6	1mo ago
HRL LRL Safety Prompts Tamil Text v1		Attack Success Rate0	6	1mo ago
HRL/LRL Safety Prompts Welsh Text v1		Attack Success Rate0	6	1mo ago
PROTOAMP Overall 1.0 (test)		ASR52.8	2	1mo ago
PROTOAMP Sampling-Based Injection 1.0 (test)		ASR67.2	2	1mo ago
PROTOAMP Cross-Server Propagation 1.0 (test)		ASR0.613	2	1mo ago
PROTOAMP Tool Response Manipulation 1.0 (test)		ASR52.1	2	1mo ago
PROTOAMP Indirect Injection 1.0 (test)		ASR47.8	2	1mo ago

Showing 22 of 22 rows