Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FB-NLL: A Feature-Based Approach to Tackle Noisy Labels in Personalized Federated Learning

About

Personalized Federated Learning (PFL) aims to learn multiple task-specific models rather than a single global model across heterogeneous data distributions. Existing PFL approaches typically rely on iterative optimization-such as model update trajectories-to cluster users that need to accomplish the same tasks together. However, these learning-dynamics-based methods are inherently vulnerable to low-quality data and noisy labels, as corrupted updates distort clustering decisions and degrade personalization performance. To tackle this, we propose FB-NLL, a feature-centric framework that decouples user clustering from iterative training dynamics. By exploiting the intrinsic heterogeneity of local feature spaces, FB-NLL characterizes each user through the spectral structure of the covariances of their feature representations and leverages subspace similarity to identify task-consistent user groupings. This geometry-aware clustering is label-agnostic and is performed in a one-shot manner prior to training, significantly reducing communication overhead and computational costs compared to iterative baselines. Complementing this, we introduce a feature-consistency-based detection and correction strategy to address noisy labels within clusters. By leveraging directional alignment in the learned feature space and assigning labels based on class-specific feature subspaces, our method mitigates corrupted supervision without requiring estimation of stochastic noise transition matrices. In addition, FB-NLL is model-independent and integrates seamlessly with existing noise-robust training techniques. Extensive experiments across diverse datasets and noise regimes demonstrate that our framework consistently outperforms state-of-the-art baselines in terms of average accuracy and performance stability.

Abdulmoneam Ali, Ahmed Arafa• 2026

Related benchmarks

TaskDatasetResultRank
ClusteringCIFAR-10 (test)--
190
ClusteringCIFAR-10
ACC89.83
52
Image ClassificationCIFAR-10 class-independent noise (test)
Accuracy91.96
21
Image ClassificationSVHN class-independent noise (test)
Accuracy94.94
21
ClusteringSVHN
Accuracy93.83
18
Personalized Federated Image ClassificationCIFAR-10 (test)
Accuracy (2 Tasks)75.92
7
Personalized Federated Image ClassificationSVHN (test)
Accuracy (2 Tasks)90.28
7
ClusteringSVHN (test)--
5
Clustering accuracyCIFAR-10
Accuracy (2 Tasks)72.19
3
Clustering accuracySVHN
Clustering Accuracy (Two Tasks)85.3
3
Showing 10 of 10 rows

Other info

Follow for update