Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Scheduling for Cellular Federated Edge Learning with Importance and Channel Awareness

About

In cellular federated edge learning (FEEL), multiple edge devices holding local data jointly train a neural network by communicating learning updates with an access point without exchanging their data samples. With very limited communication resources, it is beneficial to schedule the most informative local learning updates. In this paper, a novel scheduling policy is proposed to exploit both diversity in multiuser channels and diversity in the "importance" of the edge devices' learning updates. First, a new probabilistic scheduling framework is developed to yield unbiased update aggregation in FEEL. The importance of a local learning update is measured by its gradient divergence. If one edge device is scheduled in each communication round, the scheduling policy is derived in closed form to achieve the optimal trade-off between channel quality and update importance. The probabilistic scheduling framework is then extended to allow scheduling multiple edge devices in each communication round. Numerical results obtained using popular models and learning datasets demonstrate that the proposed scheduling policy can achieve faster model convergence and higher learning accuracy than conventional scheduling policies that only exploit a single type of diversity.

Jinke Ren, Yinghui He, Dingzhu Wen, Guanding Yu, Kaibin Huang, Dongning Guo• 2020

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-100 (test)
Accuracy68.92
3518
Image ClassificationCIFAR-10 (test)
Accuracy89.83
3381
Image ClassificationMNIST (test)
Accuracy97.06
894
Image ClassificationFashion MNIST (test)
Accuracy85.94
633
Image ClassificationSVHN (test)
Accuracy85.27
470
Image ClassificationEMNIST Balanced (test)
Accuracy77.09
34
Image ClassificationCIFAR-10
Training Time (s)201.9
4
Surface Defect DetectionGC10-Det (train/test)
Training Time (s)1.78e+3
4
Showing 8 of 8 rows

Other info

Follow for update