Lu Xiaofeng, Liao Yuying, Pietro Lio, Pan Hui. An Asynchronous Federated Learning Mechanism for Edge Network Computing[J]. Journal of Computer Research and Development, 2020, 57(12): 2571-2582. DOI: 10.7544/issn1000-1239.2020.20190754
Citation:
Lu Xiaofeng, Liao Yuying, Pietro Lio, Pan Hui. An Asynchronous Federated Learning Mechanism for Edge Network Computing[J]. Journal of Computer Research and Development, 2020, 57(12): 2571-2582. DOI: 10.7544/issn1000-1239.2020.20190754
Lu Xiaofeng, Liao Yuying, Pietro Lio, Pan Hui. An Asynchronous Federated Learning Mechanism for Edge Network Computing[J]. Journal of Computer Research and Development, 2020, 57(12): 2571-2582. DOI: 10.7544/issn1000-1239.2020.20190754
Citation:
Lu Xiaofeng, Liao Yuying, Pietro Lio, Pan Hui. An Asynchronous Federated Learning Mechanism for Edge Network Computing[J]. Journal of Computer Research and Development, 2020, 57(12): 2571-2582. DOI: 10.7544/issn1000-1239.2020.20190754
1(School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876)
2(Computer Laboratory, University of Cambridge, Cambridge CB3 0FD)
3(Department of Computer Science & Engineering, Hong Kong University of Science and Technology, Hong Kong 999077)
Funds: This work was supported by the National Natural Science Foundation of China (61472046), the Beijing Association for Science and Technology Seed Fund, and the Ant Financial Security Special Research Fund.
With the continuous improvement of the performance of the IoT and mobile devices, a new type of computing architecture, edge computing, came into being. The emergence of edge computing has changed the situation where data needs to be uploaded to the cloud for data processing, fully utilizing the computing and storage capabilities of edge IoT devices. Edge nodes process private data locally and no longer need upload a large amount of data to the cloud for processing, reducing the transmission delay. The demand for implementing artificial intelligence frameworks on edge nodes is also increasing day by day. Because the federated learning mechanism does not require centralized data for model training, it is more suitable for edge network machine learning scenarios where the average amount of data of nodes is limited. This paper proposes an efficient asynchronous federated learning mechanism for edge network computing (EAFLM), which compresses the redundant communication between the nodes and the parameter server during the training process according to the self-adaptive threshold. The gradient update algorithm based on dual-weight correction allows nodes to join or withdraw from federated learning during any process of learning. Experimental results show that when the gradient communication is compressed to 8.77% of the original communication times, the accuracy of the test set is only reduced by 0.03%.