Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FRAPPE: A Group Fairness Framework for Post-Processing Everything

About

Despite achieving promising fairness-error trade-offs, in-processing mitigation techniques for group fairness cannot be employed in numerous practical applications with limited computation resources or no access to the training pipeline of the prediction model. In these situations, post-processing is a viable alternative. However, current methods are tailored to specific problem settings and fairness definitions and hence, are not as broadly applicable as in-processing. In this work, we propose a framework that turns any regularized in-processing method into a post-processing approach. This procedure prescribes a way to obtain post-processing techniques for a much broader range of problem settings than the prior post-processing literature. We show theoretically and through extensive experiments that our framework preserves the good fairness-error trade-offs achieved with in-processing and can improve over the effectiveness of prior post-processing methods. Finally, we demonstrate several advantages of a modular mitigation strategy that disentangles the training of the prediction model from the fairness mitigation, including better performance on tasks with partial group labels.

Alexandru Tifrea, Preethi Lahoti, Ben Packer, Yoni Halpern, Ahmad Beirami, Flavien Prost• 2023

Related benchmarks

TaskDatasetResultRank
Face VerificationBFW
TPR @ FPR 0.1%91.8
138
Face VerificationLFW
AUROC98.86
67
CalibrationBFW
Worst-Group Brier Score0.043
66
Face VerificationRFW
Min-Group AUROC98.78
66
CalibrationLFW
Worst-group Brier score0.08
66
CalibrationRFW
Worst-group Brier Score0.059
66
Face VerificationLFW
Min-Group AUROC (%)97
66
Face VerificationLFW
EO Gap (0.1%)14.18
43
Face VerificationRFW
TMR @ FMR 1e-30.714
36
Face VerificationLFW headline
TPR @ FPR=1e-388.6
33
Showing 10 of 27 rows

Other info

Follow for update