Federated Learning: Challenges, Methods, and Future Directions
About
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces novel challenges that require a fundamental departure from standard approaches for large-scale machine learning, distributed optimization, and privacy-preserving data analysis. In this article, we discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.
Tian Li, Anit Kumar Sahu, Ameet Talwalkar, Virginia Smith• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Federated Learning | ACSIncome | Local Average Distance (AD)0.22 | 30 | |
| Federated Learning | Serengeti | Local Avg Distance (AD)0.18 | 12 | |
| Image Classification | Snapshot Serengeti (test) | Accuracy51 | 11 | |
| Classification | ACSIncome (test) | Global Accuracy77 | 10 | |
| Visual Question Answering | VQA v2 | Accuracy79.8 | 4 | |
| Federated Learning | FMNIST | Local Average Distance (AD)0.12 | 2 | |
| Federated Learning | CIFAR10 | Local Average Distance (AD)0.23 | 2 | |
| Federated Learning | Sent140 | Local Average Distance (AD)0.29 | 2 | |
| Federated Learning | Amazon Reviews | Local Average Distance (AD)0.26 | 2 |
Showing 9 of 9 rows