Fair Federated Medical Image Segmentation via Client Contribution Estimation
About
How to ensure fairness is an important topic in federated learning (FL). Recent studies have investigated how to reward clients based on their contribution (collaboration fairness), and how to achieve uniformity of performance across clients (performance fairness). Despite achieving progress on either one, we argue that it is critical to consider them together, in order to engage and motivate more diverse clients joining FL to derive a high-quality global model. In this work, we propose a novel method to optimize both types of fairness simultaneously. Specifically, we propose to estimate client contribution in gradient and data space. In gradient space, we monitor the gradient direction differences of each client with respect to others. And in data space, we measure the prediction error on client data using an auxiliary model. Based on this contribution estimation, we propose a FL method, federated training via contribution estimation (FedCE), i.e., using estimation as global model aggregation weights. We have theoretically analyzed our method and empirically evaluated it on two real-world medical datasets. The effectiveness of our approach has been validated with significant performance improvements, better collaboration fairness, better performance fairness, and comprehensive analytical studies.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| MRI prostate segmentation | Prostate MRI (test) | Client 1 Score91.43 | 34 | |
| Fundus Segmentation | Fundus (test) | Client 1 Score87.22 | 17 | |
| Medical Image Segmentation | RIF (test) | Site 1 Score0.8702 | 9 | |
| Retinal Fundus Segmentation | Retinal Fundus (test) | Client 1 Dice Score87.22 | 8 | |
| Client contribution estimation | Retinal Fundus Segmentation (test) | Pearson Correlation96.34 | 7 | |
| Client contribution estimation | Prostate MRI Segmentation (test) | Pearson Correlation93.53 | 7 | |
| Image Segmentation | Retinal Fundus (test) | Pearson Correlation0.8911 | 7 | |
| Image Segmentation | Prostate MRI (test) | Pearson Correlation98.25 | 7 |