AdaBFL: Multi-Layer Defensive Adaptive Aggregation for Bzantine-Robust Federated Learning
About
Federated learning (FL) is a popular distributed learning paradigm in machine learning, which enables multiple clients to collaboratively train models under the guidance of a server without exposing private client data. However, FL's decentralized nature makes it vulnerable to poisoning attacks, where malicious clients can submit corrupted models to manipulate the system. To counter such attacks, although various Byzantine-robust methods have been proposed, these methods struggle to provide balanced defense against multiple types of attacks or rely on possessing the dataset in the server. To deal with these drawbacks, thus, we propose an effective multi-layer defensive adaptive aggregation for Bzantine-robust federated learning (AdaBFL) based on a novel three-layer defensive mechanism, which can adaptively adjust the weights of defense algorithms to counter complex attacks. Moreover, we provide convergence properties of our AdaBFL method under the non-convex setting on non-iid data. Comprehensive experiments across multiple datasets validate the superiority of our AdaBFL over the comparable algorithms.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | TinyImageNet (val) | -- | 289 | |
| Byzantine-robust Federated Learning | CIFAR-10 (val) | Error Rate25.7 | 80 | |
| Federated Learning | Fashion-MNIST (val) | Error Rate9 | 80 | |
| Byzantine-robust Federated Learning | HAR | Test Error Rate4.5 | 80 | |
| Federated Learning | Shakespeare (val) | Perplexity3.721 | 73 | |
| Byzantine-robust Federated Learning | MNIST | Error Rate (No Attack)1 | 10 | |
| Image Classification | Petimage (val) | Error Rate (No Attack)22.4 | 10 |