Resisting Backdoor Attacks in Federated Learning via Bidirectional Elections and Individual Perspective
About
Existing approaches defend against backdoor attacks in federated learning (FL) mainly through a) mitigating the impact of infected models, or b) excluding infected models. The former negatively impacts model accuracy, while the latter usually relies on globally clear boundaries between benign and infected model updates. However, model updates are easy to be mixed and scattered throughout in reality due to the diverse distributions of local data. This work focuses on excluding infected models in FL. Unlike previous perspectives from a global view, we propose Snowball, a novel anti-backdoor FL framework through bidirectional elections from an individual perspective inspired by one principle deduced by us and two principles in FL and deep learning. It is characterized by a) bottom-up election, where each candidate model update votes to several peer ones such that a few model updates are elected as selectees for aggregation; and b) top-down election, where selectees progressively enlarge themselves through picking up from the candidates. We compare Snowball with state-of-the-art defenses to backdoor attacks in FL on five real-world datasets, demonstrating its superior resistance to backdoor attacks and slight impact on the accuracy of the global model.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Backdoor Defense | MNIST alpha=0.5 (non-IID) | CBA MTA98.83 | 9 | |
| Federated Image Classification | CIFAR-10 iid (test) | CBA MTA89.17 | 9 | |
| Backdoor Defense | Fashion-MNIST non-IID alpha=0.5 | CBA MTA81.18 | 9 | |
| Federated Image Classification | CIFAR-100 IID (test) | CBA MTA56.68 | 9 | |
| Image Classification | CIFAR-10 non-IID alpha=0.5 | CBA MTA69.85 | 9 | |
| Image Classification | CIFAR-100 non-IID alpha=0.5 | CBA MTA47.42 | 9 | |
| Malicious Client Detection | CIFAR-10 alpha=0.5 (Non-IID) | CBA TPR100 | 8 | |
| Malicious Client Detection | MNIST alpha=0.5 (non-IID) | CBA True Positive Rate (TPR)100 | 8 | |
| Malicious Client Detection | Fashion-MNIST alpha=0.5 (non-IID) | CBA TPR100 | 8 | |
| Malicious Client Detection | CIFAR-100 alpha=0.5 (non-IID) | CBA TPR100 | 8 |