Toxicity Classification

Benchmarks

Dataset Name	SOTA Method	Metric
CivilComments sensitive attribute: MUSLIM (test)		Balanced Accuracy59.9	57	1mo ago
Average across WZ, DC, HX, OR		Harmonic F148.8	26	1mo ago
OR		Harmonic F149.7	26	1mo ago
HX		H.-F144.2	26	1mo ago
DC	ToxiGAN	Harmonic Mean F131	26	1mo ago
WZ		Harmonic F173.4	26	1mo ago
ToxCMM	ToxVidLM	F1 Score94.35	24	1mo ago
Toxigen	MAT-STEER	Accuracy60.41	22	1mo ago
Personification GPT-3 prompted (test)	V-REx	Loss0.69	16	1mo ago
RealToxicity Prompts GPT-3 prompted (test)	V-REx	Loss0.61	16	1mo ago
CivilComments (CC) (test)	gDRO	Worst-Group Accuracy79.66	13	1mo ago
ToxiCN (test)	MacBERT + ToxiTrace	Accuracy83.87	12	4d ago
COLD (test)	RoBERTa + ToxiTrace	Accuracy83.84	12	4d ago
Toxicity Dataset (test)	CoGate-LSTM	Test Accuracy96	9	11d ago
Jigsaw (test)	CoGate-LSTM	Accuracy96	6	11d ago
Civil reconstructed with controlled shortcut injection (test)	JTT	MSTPS54.9	5	4d ago
Toxicity	AdvDemo + CW	Original Accuracy90.4	4	1mo ago
Toxicity Classification (test)	Template Attack	ASR88.4	4	1mo ago
English Civil Comments	PaLM 2	AUC-ROC85.35	4	1mo ago
Multilingual Jigsaw	PaLM 2	French Accuracy87.94	4	1mo ago
DICES 3-class (item-level)	DiADEM	Accuracy (Acc)67.79	3	9d ago
VOICED item-level (binary)	DiADEM	Accuracy80	3	9d ago
CivilComments		Average Accuracy92.6	3	1mo ago
ImplicitHate	Llama-3.2-3B-Instruct (SRD)	Accuracy83.97	2	1mo ago
Jigsaw-ML		AUC98.4	2	1mo ago

Showing 25 of 28 rows