A Reductions Approach to Fair Classification
About
We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special cases. The key idea is to reduce fair classification to a sequence of cost-sensitive classification problems, whose solutions yield a randomized classifier with the lowest (empirical) error subject to the desired constraints. We introduce two reductions that work for any representation of the cost-sensitive classifier and compare favorably to prior baselines on a variety of data sets, while overcoming several of their disadvantages.
Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\'ik, John Langford, Hanna Wallach• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | Adult (test) | Bias0.01 | 24 | |
| Classification | DCCC (test) | Bias0.01 | 24 | |
| Classification | Adult (test) | Min Test Accuracy83.9 | 24 | |
| Binary Classification | DCCC (test) | Accuracy (Test)81.4 | 16 | |
| Classification | German Credit | F1 Score82.5 | 15 | |
| Binary Classification | COMPAS | Accuracy66.1 | 12 | |
| Binary Classification | German | Accuracy73.5 | 12 | |
| Binary Classification | Heart | Accuracy91.61 | 12 | |
| Binary Classification | Adult | Accuracy84.04 | 12 | |
| Mortality Prediction | MIMIC IV | AUROC0.868 | 10 |
Showing 10 of 23 rows