Bias-in-Bios
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Bias Mitigation | Bias in Bios | Accuracy94.72 | 40 | |
| Occupation Classification | Bias-in-Bios | Accuracy (Overall)73.4 | 18 | |
| Concept Identifiability | Bias-in-Bios | MCC0.9731 | 12 | |
| Text-to-image generation | Bias-in-Bios | Mismatch Rate |M-F|3.62 | 6 | |
| Text-to-image generation | Bias-in-Bios prompts (83 occupations) | Mismatch Rate (M-F)1.48 | 6 | |
| Fairness metric evaluation | Bias in Bios (test) | Correlation0.206 | 6 | |
| Biography Classification | Bias-in-Bios | Kendall's tau (Compression)0.6 | 6 |
Showing 7 of 7 rows