Harmful Content Detection

Benchmarks

Dataset Name	SOTA Method	Metric
HoliSafe-Bench	Qwen3-VL 8B	AUPRC75.6	49	1mo ago
UnsafeBench	Gemma	AUPRC71.7	49	1mo ago
PHEME New Attacks: ExplainDrive (test)	LLM-SGA/ARHOCD	Accuracy82.91	15	3mo ago
Fortress	SInternal	ASR18.6	12	22d ago
PHEME Known Attacks: DeepWordBug, TFAdjusted, TREPAT (test)	LLM-SGA/ARHOCD	Accuracy85.59	10	3mo ago
ELF-HP	Perspective API	Accuracy48.57	8	1mo ago
ELF22	Perspective API	Accuracy43.96	8	1mo ago
CADD	Perspective API	Accuracy90.19	8	1mo ago
COVID-HATE	Perspective API	Accuracy96.4	8	1mo ago
MT-CONAN	LlamaGuard-1	Accuracy97.24	8	1mo ago
CONAN	LlamaGuard-1	Accuracy98.47	8	1mo ago
Qian-Reddit		Accuracy97.09	8	1mo ago
Qian-Gab		Accuracy99.06	8	1mo ago
FoodGuardBench (test)	FoodGuard-4B	FNR2.75	7	2mo ago
BeaverTails Harmful (held-out target labels)	Quotient Transfer	AUROC0.793	6	21d ago
Trolling-oriented generations DeepSeek-Llama 70B	Perspective API	Accuracy16.24	4	1mo ago
Trolling-oriented generations Llama-3.1 70B		Accuracy26.04	4	1mo ago
Trolling-oriented generations GPT-4o	Perspective API	Accuracy19.88	4	1mo ago
CADD DeepSeek generations	Perspective API	Accuracy60.13	4	1mo ago
CADD Llama-3.1 generations	Perspective API	Accuracy69.18	4	1mo ago
CADD GPT-4o generations	Perspective API	Accuracy64.84	4	1mo ago
Ours trolling-oriented synthetic	Perspective API	Accuracy19.88	4	1mo ago
Ours CADD-based synthetic	Perspective API	Accuracy65.55	4	1mo ago
Standard Harmful Content Datasets Evasion Attack	GAVEL	Phishing96	3	3mo ago
Standard Harmful Content Datasets (Goal Hijacking Attack)	GAVEL	Phishing96	2	3mo ago

Showing 25 of 26 rows