Safety Classification

Benchmarks

Dataset Name	SOTA Method	Metric
SafeRLHF		F1 Score0.94	48	1mo ago
WildGuardMix (test)	LEG large	F1 (Unsafe)75.83	27	1mo ago
XSTest (test)	LEG large	F192.91	20	1mo ago
XSTest	AprielGuard	F1 Score94	16	1mo ago
Wildguardmix	Apriel Guard	F1 Score76	15	1mo ago
HarmBench	IBM Granite Guardian 3.2	Recall100	14	1mo ago
AegisSafetyTest V2		F1 Score87	14	1mo ago
AegisSafety V1 (test)		F1 Score92	14	1mo ago
ToxicChat		F1 Score0.81	14	1mo ago
XSTestResponse	AprielGuard	F1 Score0.96	14	1mo ago
Aya Redteaming	IBM Granite Guardian 3.1	Recall94	14	1mo ago
SimpleSafetyTests	IBM Granite Guardian 3.2	Recall100	14	1mo ago
SafeEditBench	Llama Guard	Policy L1 Success Rate100	11	1mo ago
ToxicChat (out-of-distribution)	Multi-head self-attn	F1 Score72.88	11	1mo ago
AdvBench	Gradient-Controlled Decoding (GCD)	F1 Score99.9	10	10d ago
HarmBench (test)		F1 Score90.5	9	1mo ago
OAI (test)		F1 Score86.5	9	1mo ago
WildGuardMix-p (test)		F1 Score93.2	9	1mo ago
DiaSafety (test)	GAUGE-mean	AUROC66.98	8	1mo ago
OS Bench	CLUE	Recall0.936	8	1mo ago
GuardSet (test)		Accuracy (Harmless)96.26	7	9d ago
Bloom safety filter benchmark 100 examples (corrected) (test)	Bloom Safety Filter	Accuracy100	7	1mo ago
Bloom safety filter benchmark 100 examples (test)	Bloom Safety Filter	Accuracy100	7	1mo ago
Bloom safety filter benchmark 400 examples (val)	Bloom Safety Filter	Accuracy100	7	1mo ago
3,000 Polish user prompts (test)	Bielik Guard 0.1B v1.1	Precision77.65	7	1mo ago

Showing 25 of 46 rows