SP-CACW: Convergence-Aware Client Weighting for Selfish Personalized Learning
About
Collaborative learning is sustainable only when it benefits each participant. Standard federated learning optimizes a global average objective, which can under perform for clients whose data distributions differ substantially from the population. We study selfish personalization: how a designated target client can use peer gradients to minimize its own risk while avoiding negative transfer. We propose SP-CACW, a convergence-aware client-weighting framework that selects aggregation weights by minimizing an upper bound on the target client's convergence error. The resulting rule explicitly trades off peer bias against stochastic variance and can assign zero weight to harmful peers. We provide convergence guarantees under smoothness and bounded-variance assumptions and evaluate the method on MNIST, CIFAR-100, and LEAF Shakespeare, where it is competitive with or improves over strong personalized and clustering baselines.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | MNIST-Rotation (test) | Avg Acc89.4 | 16 | |
| Image Classification | CIFAR-100 sigma=0.01 (test) | Test Accuracy51.58 | 8 | |
| Image Classification | CIFAR-100 sigma=10 (test) | Test Accuracy52.91 | 8 | |
| Image Classification | MNIST Label-Switching (test) | Accuracy (Test)94.85 | 8 | |
| Next-Character Prediction | Shakespeare n=15, m=7 (test) | Test Accuracy53.67 | 7 | |
| Next-Character Prediction | Shakespeare (n=30, m=3) (test) | Accuracy51.63 | 7 |