Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SubFLOT: Submodel Extraction for Efficient and Personalized Federated Learning via Optimal Transport

About

Federated Learning (FL) enables collaborative model training while preserving data privacy, but its practical deployment is hampered by system and statistical heterogeneity. While federated network pruning offers a path to mitigate these issues, existing methods face a critical dilemma: server-side pruning lacks personalization, whereas client-side pruning is computationally prohibitive for resource-constrained devices. Furthermore, the pruning process itself induces significant parametric divergence among heterogeneous submodels, destabilizing training and hindering global convergence. To address these challenges, we propose SubFLOT, a novel framework for server-side personalized federated pruning. SubFLOT introduces an Optimal Transport-enhanced Pruning (OTP) module that treats historical client models as proxies for local data distributions, formulating the pruning task as a Wasserstein distance minimization problem to generate customized submodels without accessing raw data. Concurrently, to counteract parametric divergence, our Scaling-based Adaptive Regularization (SAR) module adaptively penalizes a submodel's deviation from the global model, with the penalty's strength scaled by the client's pruning rate. Comprehensive experiments demonstrate that SubFLOT consistently and substantially outperforms state-of-the-art methods, underscoring its potential for deploying efficient and personalized models on resource-constrained edge devices.

Zheng Jiang, Nan He, Yiming Chen, Lifeng Sun• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-10
Accuracy83.78
508
Image ClassificationPACS
Overall Average Accuracy41.58
241
Image ClassificationDigits-Five
Accuracy (Source: mt)98.65
55
Image ClassificationTiny-ImageNet
Accuracy (%)25.15
27
Human Activity RecognitionHAR Real-world Setting (test)
Accuracy79.72
11
Image ClassificationCIFAR10 Pathological Label Skew (test)
Accuracy86.89
11
Image ClassificationCIFAR100 Pathological Label Skew (test)
Accuracy58.37
11
Image ClassificationTinyImageNet Pathological Label Skew (test)
Accuracy29.3
11
Image ClassificationCIFAR10 Practical Label Skew Dirichlet (test)
Accuracy83.78
11
Image ClassificationCIFAR100 Practical Label Skew Dirichlet (test)
Accuracy44.88
11
Showing 10 of 12 rows

Other info

Follow for update