A Reductions Approach to Fair Classification
About
We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special cases. The key idea is to reduce fair classification to a sequence of cost-sensitive classification problems, whose solutions yield a randomized classifier with the lowest (empirical) error subject to the desired constraints. We introduce two reductions that work for any representation of the cost-sensitive classifier and compare favorably to prior baselines on a variety of data sets, while overcoming several of their disadvantages.
Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\'ik, John Langford, Hanna Wallach• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | Adult (test) | Bias0.01 | 24 | |
| Classification | DCCC (test) | Bias0.01 | 24 | |
| Classification | Adult (test) | Min Test Accuracy83.9 | 24 | |
| Binary Classification | DCCC (test) | Accuracy (Test)81.4 | 16 | |
| Mortality Prediction | MIMIC IV | AUROC0.868 | 10 | |
| Fairness-aware Classification | COMPAS | Training Time (min)2 | 7 | |
| Fairness-aware Classification | CelebA | Training Time (min)70 | 7 | |
| Fairness-aware Classification | Jigsaw | Training Time (min)290 | 7 | |
| Fairness-aware Classification | Adult | Training Time (min)3 | 7 |
Showing 9 of 9 rows