Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Minimax Pareto Fairness: A Multi Objective Perspective

About

In this work we formulate and formally characterize group fairness as a multi-objective optimization problem, where each sensitive group risk is a separate objective. We propose a fairness criterion where a classifier achieves minimax risk and is Pareto-efficient w.r.t. all groups, avoiding unnecessary harm, and can lead to the best zero-gap model if policy dictates so. We provide a simple optimization algorithm compatible with deep neural networks to satisfy these constraints. Since our method does not require test-time access to sensitive attributes, it can be applied to reduce worst-case classification errors between outcomes in unbalanced classification problems. We test the proposed methodology on real case-studies of predicting income, ICU patient mortality, skin lesions classification, and assessing credit risk, demonstrating how our framework compares favorably to other approaches.

Natalia Martinez, Martin Bertran, Guillermo Sapiro• 2020

Related benchmarks

TaskDatasetResultRank
ClassificationGerman Credit (test)
Accuracy71.3
16
Fair ClassificationGerman Credit (test)
Equal Opportunity Difference75.3
15
ClassificationACSIncome state RI (test)
Avg Accuracy77.4
14
Income PredictionACSIncome state MT (test)
AV.ACC73.8
14
Income PredictionACSIncome (state RI)
Average Accuracy (AV.ACC)76
14
ClassificationACSEmployment CT (test)
AV.ACC72.5
14
Employment PredictionACSEmployment state LA (test)
AV.ACC72.8
14
Employment PredictionACSEmployment MI (test)
AV.ACC73.5
14
Employment PredictionACSEmployment OR (Oregon) (test)
AV.ACC74.1
14
Employment status predictionACSEmployment 2018 (state IA)
Average Accuracy0.722
14
Showing 10 of 13 rows

Other info

Follow for update