Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Proportional Fairness in Federated Learning

About

With the increasingly broad deployment of federated learning (FL) systems in the real world, it is critical but challenging to ensure fairness in FL, i.e. reasonably satisfactory performances for each of the numerous diverse clients. In this work, we introduce and study a new fairness notion in FL, called proportional fairness (PF), which is based on the relative change of each client's performance. From its connection with the bargaining games, we propose PropFair, a novel and easy-to-implement algorithm for finding proportionally fair solutions in FL and study its convergence properties. Through extensive experiments on vision and language datasets, we demonstrate that PropFair can approximately find PF solutions, and it achieves a good balance between the average performances of all clients and of the worst 10% clients. Our code is available at \url{https://github.com/huawei-noah/Federated-Learning/tree/main/FairFL}.

Guojun Zhang, Saber Malekmohammadi, Xi Chen, Yaoliang Yu• 2022

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR10 Partial Class C=5
Accuracy53.794
15
Image ClassificationCIFAR10 Partial Class C=2 (test)
Accuracy35.505
15
Image ClassificationCIFAR10 Partial Class C=2
Accuracy35.505
15
Image ClassificationCIFAR10 Rotation
Accuracy63.108
15
ClassificationMNIST Partial Class C=2 (test)
Accuracy91.274
15
Image ClassificationMNIST Partial Class C=5
Accuracy92.865
15
Image ClassificationMNIST Rotation
Average Accuracy90.622
15
Image ClassificationMNIST Partial Class C=5 (test)
Average Accuracy92.865
15
Showing 8 of 8 rows

Other info

Follow for update