Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Minimax Group Fairness: Algorithms and Experiments

About

We consider a recently introduced framework in which fairness is measured by worst-case outcomes across groups, rather than by the more standard differences between group outcomes. In this framework we provide provably convergent oracle-efficient learning algorithms (or equivalently, reductions to non-fair learning) for minimax group fairness. Here the goal is that of minimizing the maximum loss across all groups, rather than equalizing group losses. Our algorithms apply to both regression and classification settings and support both overall error and false positive or false negative rates as the fairness measure of interest. They also support relaxations of the fairness constraints, thus permitting study of the tradeoff between overall accuracy and minimax fairness. We compare the experimental behavior and performance of our algorithms across a variety of fairness-sensitive data sets and show empirical cases in which minimax fairness is strictly and strongly preferable to equal outcome notions.

Emily Diana, Wesley Gill, Michael Kearns, Krishnaram Kenthapadi, Aaron Roth• 2020

Related benchmarks

TaskDatasetResultRank
ClassificationGerman Credit (test)
Accuracy71.8
16
Fair ClassificationGerman Credit (test)
Equal Opportunity Difference72.1
15
ClassificationACSIncome state RI (test)
Avg Accuracy76.7
14
Income PredictionACSIncome (state RI)
Average Accuracy (AV.ACC)76.4
14
Tabular ClassificationACSIncome state VT
Average Accuracy74.2
14
ClassificationACSEmployment CT (test)
AV.ACC71.4
14
Employment PredictionACSEmployment state LA (test)
AV.ACC71.4
14
Employment PredictionACSEmployment OR (Oregon) (test)
AV.ACC70.3
14
Employment status predictionACSEmployment 2018 (state IA)
Average Accuracy0.72
14
Income PredictionACSIncome state MT (test)
AV.ACC72.7
14
Showing 10 of 13 rows

Other info

Follow for update