Minimax Pareto Fairness: A Multi Objective Perspective
About
In this work we formulate and formally characterize group fairness as a multi-objective optimization problem, where each sensitive group risk is a separate objective. We propose a fairness criterion where a classifier achieves minimax risk and is Pareto-efficient w.r.t. all groups, avoiding unnecessary harm, and can lead to the best zero-gap model if policy dictates so. We provide a simple optimization algorithm compatible with deep neural networks to satisfy these constraints. Since our method does not require test-time access to sensitive attributes, it can be applied to reduce worst-case classification errors between outcomes in unbalanced classification problems. We test the proposed methodology on real case-studies of predicting income, ICU patient mortality, skin lesions classification, and assessing credit risk, demonstrating how our framework compares favorably to other approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | German Credit (test) | Accuracy71.3 | 16 | |
| Fair Classification | German Credit (test) | Equal Opportunity Difference75.3 | 15 | |
| Classification | ACSIncome state RI (test) | Avg Accuracy77.4 | 14 | |
| Income Prediction | ACSIncome state MT (test) | AV.ACC73.8 | 14 | |
| Income Prediction | ACSIncome (state RI) | Average Accuracy (AV.ACC)76 | 14 | |
| Classification | ACSEmployment CT (test) | AV.ACC72.5 | 14 | |
| Employment Prediction | ACSEmployment state LA (test) | AV.ACC72.8 | 14 | |
| Employment Prediction | ACSEmployment MI (test) | AV.ACC73.5 | 14 | |
| Employment Prediction | ACSEmployment OR (Oregon) (test) | AV.ACC74.1 | 14 | |
| Employment status prediction | ACSEmployment 2018 (state IA) | Average Accuracy0.722 | 14 |