Bias Detection

Benchmarks

Dataset Name	SOTA Method	Metric
RedditBias (test)	BiasGuard	Acc79.3	12	5mo ago
The Gab Hate (GHC) (test)	BiasGuard	Accuracy71.25	12	5mo ago
SBIC (test)	DeepSeek-R1-32B	Accuracy93.6	12	5mo ago
Implicit Toxicity (test)	BiasGuard	Accuracy81	12	5mo ago
Toxigen (test)	Toxigen	Accuracy90.3	12	5mo ago
ImageNet-X 1.0 (val)	C2B	GT → Detected HIT11.21	12	5mo ago
BABE (test)	mini_listwise_BT	Macro F180.8	8	5mo ago
CelebA (val)	C2B	HIT Rate14.18	6	5mo ago
Paired-prompt bias evaluation (Gender, Race, Religion, Age, Nationality)	Meta Llama 3 8B	Bias Detection Rate0	4	1mo ago
University Admissions Task dataset		Ethnicity Bias Delta (White-sounding Favored)-0.029	4	5mo ago
Loan Approval Task		Bias: Favors Female (Gender)0.017	4	5mo ago
Colored MNIST Unbiased 33/33/33	ActivationBias (Level 2)	Specificity95	2	17d ago
Colored MNIST red-biased family Severity IV 60 20 20	ActivationBias (Level 2)	Recall86	2	17d ago
Colored MNIST red-biased Severity III 80/10/10	ActivationBias (Level 2)	Recall100	2	17d ago
Colored MNIST red-biased Severity II 90/5/5	ActivationBias (Level 2)	Recall100	2	17d ago
Colored MNIST red-biased family Severity I 99/.5/.5	ActivationBias (Level 2)	Recall100	2	17d ago

Showing 16 of 16 rows