Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Attack-Resistant Federated Learning with Residual-based Reweighting

About

Federated learning has a variety of applications in multiple domains by utilizing private training data stored on different devices. However, the aggregation process in federated learning is highly vulnerable to adversarial attacks so that the global model may behave abnormally under attacks. To tackle this challenge, we present a novel aggregation algorithm with residual-based reweighting to defend federated learning. Our aggregation algorithm combines repeated median regression with the reweighting scheme in iteratively reweighted least squares. Our experiments show that our aggregation algorithm outperforms other alternative algorithms in the presence of label-flipping and backdoor attacks. We also provide theoretical analysis for our aggregation algorithm.

Shuhao Fu, Chulin Xie, Bo Li, Qifeng Chen• 2019

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-100 (test)
Accuracy72.05
3518
Image ClassificationCIFAR-10 (test)
Accuracy60.19
3381
Image ClassificationClothing1M (test)
Accuracy70.91
598
Image ClassificationCIFAR-100 non-IID (test)
Test Accuracy (Avg Best)48.03
113
Image ClassificationCIFAR-10 IID partition (test)
Targeted Communication Cost120
48
Image ClassificationCIFAR-10 (test)
Targeted Communication Cost290
33
Safety and Utility EvaluationBeaverTails & WildChat
Rule Adherence50.58
11
Robust Safety and Utility Evaluation in Federated LearningBeaverTails & LMSYS-Chat
Rule Score53.08
8
Robust Safety and Utility Evaluation in Federated LearningMaliciousGen & LMSYS-Chat
Rule Compliance52.88
8
Robust Safety and Utility Evaluation in Federated LearningMaliciousGen & WildChat
Rule Score47.31
8
Showing 10 of 16 rows

Other info

Follow for update