Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FedSDWC: Federated Synergistic Dual-Representation Weak Causal Learning for OOD

About

Amid growing demands for data privacy and advances in computational infrastructure, federated learning (FL) has emerged as a prominent distributed learning paradigm. Nevertheless, differences in data distribution (such as covariate and semantic shifts) severely affect its reliability in real-world deployments. To address this issue, we propose FedSDWC, a causal inference method that integrates both invariant and variant features. FedSDWC infers causal semantic representations by modeling the weak causal influence between invariant and variant features, effectively overcoming the limitations of existing invariant learning methods in accurately capturing invariant features and directly constructing causal representations. This approach significantly enhances FL's ability to generalize and detect OOD data. Theoretically, we derive FedSDWC's generalization error bound under specific conditions and, for the first time, establish its relationship with client prior distributions. Moreover, extensive experiments conducted on multiple benchmark datasets validate the superior performance of FedSDWC in handling covariate and semantic shifts. For example, FedSDWC outperforms FedICON, the next best baseline, by an average of 3.04% on CIFAR-10 and 8.11% on CIFAR-100.

Zhenyuan Huang, Hui Zhang, Wenzhong Tang, Haijun Yang• 2025

Related benchmarks

TaskDatasetResultRank
Out-of-Distribution DetectionCIFAR-10 (ID) vs SVHN (OOD) (test)
AUROC88.08
88
Out-of-Distribution DetectionCIFAR10 (ID) / ISUN (OOD) (test)
FPR@9536.22
50
OOD DetectionCIFAR-10 (In-distribution) vs LSUN-R (Out-of-distribution)
FPR9536.69
34
Federated OOD DetectionCIFAR-100 (test)
FPR@9558.88
27
Multi-Class Out-of-Distribution DetectionCIFAR-10 (in-distribution) vs Textures (out-of-distribution) (test)
FPR@9537.2
27
Out-of-Distribution DetectionCIFAR10 (ID) LSUN-Crop (OOD) (test)
FPR@9532.61
27
Federated Out-of-Distribution DetectionCIFAR-10
FPR@9529.65
16
Domain GeneralizationPACS (out-of-domain)
Accuracy (Art Domain)98.56
15
Federated Out-of-Distribution GeneralizationCIFAR-100-C 1.0 (test)
Overall Accuracy78.05
11
Federated OOD DetectionTinyImageNet
FPR9525.51
7
Showing 10 of 11 rows

Other info

Follow for update