Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Data-Free Contribution Estimation in Federated Learning using Gradient von Neumann Entropy

About

Client contribution estimation in Federated Learning is necessary for identifying clients' importance and for providing fair rewards. Current methods often rely on server-side validation data or self-reported client information, which can compromise privacy or be susceptible to manipulation. We introduce a data-free signal based on the matrix von Neumann (spectral) entropy of the final-layer updates, which measures the diversity of the information contributed. We instantiate two practical schemes: (i) SpectralFed, which uses normalized entropy as aggregation weights, and (ii) SpectralFuse, which fuses entropy with class-specific alignment via a rank-adaptive Kalman filter for per-round stability. Across CIFAR-10/100 and the naturally partitioned FEMNIST and FedISIC benchmarks, entropy-derived scores show a consistently high correlation with standalone client accuracy under diverse non-IID regimes - without validation data or client metadata. We compare our results with data-free contribution estimation baselines and show that spectral entropy serves as a useful indicator of client contribution.

Asim Ukaye, Mubarak Abdu-Aguye, Nurbek Tastan, Karthik Nandakumar• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-10
Accuracy82.81
875
Image ClassificationCIFAR-100
Accuracy42.97
357
Image ClassificationCIFAR-10 IID
Accuracy82.27
185
Image ClassificationCIFAR-100 IID
Accuracy42.7
47
Image ClassificationCIFAR-100 Step-Imbalance
Accuracy43.88
29
Image ClassificationCIFAR-10 Dirichlet alpha=0.1
Global Accuracy76.24
17
Client Contribution Estimation CorrelationCIFAR-10 Dirichlet (α = 0.01)
Average Pearson Correlation0.97
10
Image ClassificationFedISIC (Natural split)
Balanced Accuracy55.59
10
Client Contribution Estimation CorrelationCIFAR-10 Only Label Skew
Average Pearson Correlation0.97
5
Client Contribution Estimation CorrelationCIFAR-10 Step Label Skew
Average PCC0.97
5
Showing 10 of 25 rows

Other info

Follow for update