Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Distribution Alignment for One-Shot Federated Learning via Optimal Transport

About

One-Shot Federated Learning (OSFL) addresses extreme communication regimes in which clients interact with the server only once, amplifying the impact of heterogeneous client data distributions. In particular, the interaction of domain shift and label shift across clients induces misaligned feature representations that cannot be corrected through iterative optimization. Existing OSFL methods rely on distillation, server-side generation or ensemble-based aggregation, but assume aligned representations or address domain and label shift separately. We introduce SLOT-Align (Single-round, Learning-free Optimal Transport Alignment), a geometry-aware feature harmonization framework for OSFL. SLOT-Align uses a shared frozen encoder to extract compact feature statistics, constructs a global reference via Bures-Wasserstein barycenters, and aligns local representations using closed-form geodesic optimal transport maps. The method is computationally efficient and can be combined with existing OSFL pipelines relying on frozen encoders without modifying their training procedures. Extensive experiments across multiple benchmarks, pretrained backbones, and OSFL methods show that SLOT-Align consistently improves accuracy and robustness under joint domain and label shift.

Daniele Berardini, Vito Paolo Pastore, Vittorio Murino (1 and 3) __INSTITUTION_3__ AI for Good __INSTITUTION_4__, Italian Institute of Technology, Genoa, Italy, (2) MaLGa-DIBRIS, University of Genoa, Genoa, Italy, (3) Department of Computer Science, University of Verona, Verona, Italy)• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationOffice-Home (test)
Mean Accuracy82.23
402
Image ClassificationDomainNet (test)
Average Accuracy52.36
272
ClassificationDIGITS (test)
Average Accuracy70.42
65
Image ClassificationOffice-Home alpha=0.1 (test)
Accuracy (A)80.66
7
Image ClassificationDigits alpha=0.1 (test)
Accuracy (MNIST Domain)86.87
7
Image ClassificationDomainNet alpha=0.1 (test)
Accuracy (Clipart)70
7
Image ClassificationOffice-Home alpha=0.01
Accuracy (A)72.29
6
Image ClassificationDigits alpha=0.01
Accuracy (MNIST)74.95
6
Image ClassificationDomainNet alpha=0.01
Clipart Accuracy65.23
6
Showing 9 of 9 rows

Other info

Follow for update