SOTA Safety Classification benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
AUTALIC (test)		F1 Score37.7	64	1mo ago
HoliSafe-Bench	Qwen3-VL 8B	AUROC0.783	49	2mo ago
UnsafeBench	Gemma	AUROC80.5	49	2mo ago
SafeRLHF		F1 Score0.94	48	3mo ago
WildGuardMix (test)	OSS-Safeguard-20B-High	F1 Score95.3	47	1mo ago
XSTest	Label and intent reward	F1 Score95.8	46	17d ago
ToxicChat (test)	D2-TimeAttn	Accuracy97.3	43	2mo ago
WildGuard (test)	WildGuard 7B	F1 Score88.8	35	29d ago
ToxicChat		F1 Score0.81	32	29d ago
AEGIS 2	YuFeng-XGuard-Reason-0.6B	F1 Score86.2	30	17d ago
Wildguardmix	SingGuard-4B	F1 Score89.54	29	1mo ago
BeaverTails (test)		AUC94	24	2mo ago
AEGIS 2.0 (test)	DSA:LST	AUC94	24	2mo ago
OpenAI-moderation (test)	TPC	Accuracy74.88	23	2mo ago
HoliSafe-Bench	Llama	ECE8.4	21	2mo ago
UnsafeBench	Llama	ECE0.061	21	2mo ago
Pre-Ex-Bench	TRACE	Accuracy94.01	20	1mo ago
ASSEBench	TRACE	Accuracy92.04	20	1mo ago
XSTest (test)	LEG large	F192.91	20	18d ago
OpenAI Moderation	ShieldGemma 27B	F1 Score81.4	18	29d ago
Combined Chinese Safety Datasets	CHILLGuard-4B	Overall Average Score77.93	16	1mo ago
Chinese Response Datasets	Qwen3Guard-0.6B-Strict	Beavertails Score85.11	16	1mo ago
Chinese Prompt Datasets	PolyGuard-7B	PolyG86.31	16	1mo ago
MultiJail	CREST-BASE	F1 Score0.9335	15	2mo ago
HarmBench	IBM Granite Guardian 3.2	Recall100	14	4mo ago

Showing 25 of 94 rows