Sun Bing, Liu Yan, Wang Tian, Peng Shaoliang, Wang Guojun, Jia Weijia. Survey on Optimization of Federated Learning Efficiency in Mobile Edge Networks[J]. Journal of Computer Research and Development, 2022, 59(7): 1439-1469. DOI: 10.7544/issn1000-1239.20210119
Citation:
Sun Bing, Liu Yan, Wang Tian, Peng Shaoliang, Wang Guojun, Jia Weijia. Survey on Optimization of Federated Learning Efficiency in Mobile Edge Networks[J]. Journal of Computer Research and Development, 2022, 59(7): 1439-1469. DOI: 10.7544/issn1000-1239.20210119
Sun Bing, Liu Yan, Wang Tian, Peng Shaoliang, Wang Guojun, Jia Weijia. Survey on Optimization of Federated Learning Efficiency in Mobile Edge Networks[J]. Journal of Computer Research and Development, 2022, 59(7): 1439-1469. DOI: 10.7544/issn1000-1239.20210119
Citation:
Sun Bing, Liu Yan, Wang Tian, Peng Shaoliang, Wang Guojun, Jia Weijia. Survey on Optimization of Federated Learning Efficiency in Mobile Edge Networks[J]. Journal of Computer Research and Development, 2022, 59(7): 1439-1469. DOI: 10.7544/issn1000-1239.20210119
1(College of Computer Science and Technology, Huaqiao University, Xiamen, Fujian 361021)
2(Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai, Guangdong 519087)
3(Key Laboratory of Artificial Intelligence and Multi-Modal Data Processing, Beijing Normal University-Hong Kong Baptist University United International College, Zhuhai, Guangdong 519087) 4(College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082)
5(School of Computer Science and Cyber Engineering, Guangzhou University, Guangzhou 510006)
Funds: This work was supported by the National Key Research and Development Program of China (2022YFE0201400), the National Natural Science Foundation of China (62172046), the Natural Science Foundation of Fujian Province of China (2020J06023), the Special Project of Guangdong Provincial Department of Education in Key Fields of Colleges and Universities (2021ZDZX1063), the Joint Project of Production, Teaching and Research of Zhuhai (ZH22017001210133PWC), the Key Laboratory Project for AI and Multi-modal Data Processing of Department of Education of Guangdong Province (2020KSYS007), and the UIC Start-up Research Fund (R72021202).
Federated learning deploys deep learning training tasks on mobile edge networks. Mobile devices participating in learning only need to send the trained local models to the server instead of sending personal data, thereby protecting the data privacy of users. To speed up the implementation of federated learning, optimization of efficiency is the key. The main factors affecting efficiency include communication consumption between device and server, model convergence rate, and security and privacy risk of mobile edge networks. Based on thoroughly investigating the existing optimization methods, we summarize the efficiency optimization of federated learning into communication optimization, training optimization, and protection mechanism for the first time. Specifically, we discuss the optimization of federated learning communication from two aspects of edge computing coordination and model compression which can reduce the frequency of communication and resource consumption. Then, we review the optimization of federated learning process from four elements of device selection, resource coordination, model aggregation control, and data optimization similarly, because there are many heterogeneous factors in the mobile edge networks, such as the different computing resources of mobile devices and different data quality. Furthermore, the security and privacy protection mechanisms of federated learning are expounded. After comparing the innovation points and contributions of related technologies, the advantages and disadvantages of the existing solutions are concluded and the new challenges faced by federated learning are discussed. Finally, we propose edge-intelligent federated learning based on the idea of edge computing, provide innovative methods and future research directions in data optimization, adaptive learning, incentive mechanisms, and advanced technology.