FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attacks
About
Federated learning (FL) is revolutionizing how we learn from data. With its growing popularity, it is now being used in many safety-critical domains such as autonomous vehicles and healthcare. Since thousands of participants can contribute in this collaborative setting, it is, however, challenging to ensure security and reliability of such systems. This highlights the need to design FL systems that are secure and robust against malicious participants' actions while also ensuring high utility, privacy of local data, and efficiency. In this paper, we propose a novel FL framework dubbed as FLShield that utilizes benign data from FL participants to validate the local models before taking them into account for generating the global model. This is in stark contrast with existing defenses relying on server's access to clean datasets -- an assumption often impractical in real-life scenarios and conflicting with the fundamentals of FL. We conduct extensive experiments to evaluate our FLShield framework in different settings and demonstrate its effectiveness in thwarting various types of poisoning and backdoor attacks including a defense-aware one. FLShield also preserves privacy of local data against gradient inversion attacks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Federated Image Classification | CIFAR-10 iid (test) | CBA MTA91.97 | 9 | |
| Backdoor Defense | MNIST alpha=0.5 (non-IID) | CBA MTA99.14 | 9 | |
| Federated Image Classification | CIFAR-100 IID (test) | CBA MTA70.78 | 9 | |
| Image Classification | CIFAR-10 non-IID alpha=0.5 | CBA MTA90.05 | 9 | |
| Image Classification | CIFAR-100 non-IID alpha=0.5 | CBA MTA69.3 | 9 | |
| Backdoor Defense | Fashion-MNIST non-IID alpha=0.5 | CBA MTA89.21 | 9 | |
| Malicious Client Detection | Fashion-MNIST alpha=0.5 (non-IID) | CBA TPR99 | 8 | |
| Malicious Client Detection | MNIST alpha=0.5 (non-IID) | CBA True Positive Rate (TPR)22.8 | 8 | |
| Malicious Client Detection | CIFAR-10 alpha=0.5 (Non-IID) | CBA TPR12.5 | 8 | |
| Malicious Client Detection | CIFAR-100 alpha=0.5 (non-IID) | CBA TPR28.7 | 8 |