摘要:
联邦学习(federated learning)将模型训练任务部署在移动边缘设备，参与者只需将训练后的本地模型发送到服务器参与全局聚合而无须发送原始数据，提高了数据隐私性.然而，解决效率问题是联邦学习落地的关键.影响效率的主要因素包括设备与服务器之间的通信消耗、模型收敛速率以及移动边缘网络中存在的安全与隐私风险.在充分调研后，首先将联邦学习的效率优化归纳为通信、训练与安全隐私保护3类.具体来说，从边缘协调与模型压缩的角度讨论分析了通信优化方案；从设备选择、资源协调、聚合控制与数据优化4个方面讨论分析了训练优化方案；从安全与隐私的角度讨论分析了联邦学习的保护机制.其次，通过对比相关技术的创新点与贡献，总结了现有方案的优点与不足，探讨了联邦学习所面临的新挑战.最后，基于边缘计算的思想提出了边缘化的联邦学习解决方案，在数据优化、自适应学习、激励机制和隐私保护等方面给出了创新理念与未来展望.
Abstract:
Federated learning deploys deep learning training tasks on mobile edge networks. Mobile devices participating in learning only need to send the trained local models to the server instead of sending personal data, thereby protecting the data privacy of users. To speed up the implementation of federated learning, optimization of efficiency is the key. The main factors affecting efficiency include communication consumption between device and server, model convergence rate, and security and privacy risk of mobile edge networks. Based on thoroughly investigating the existing optimization methods, we summarize the efficiency optimization of federated learning into communication optimization, training optimization, and protection mechanism for the first time. Specifically, we discuss the optimization of federated learning communication from two aspects of edge computing coordination and model compression which can reduce the frequency of communication and resource consumption. Then, we review the optimization of federated learning process from four elements of device selection, resource coordination, model aggregation control, and data optimization similarly, because there are many heterogeneous factors in the mobile edge networks, such as the different computing resources of mobile devices and different data quality. Furthermore, the security and privacy protection mechanisms of federated learning are expounded. After comparing the innovation points and contributions of related technologies, the advantages and disadvantages of the existing solutions are concluded and the new challenges faced by federated learning are discussed. Finally, we propose edge-intelligent federated learning based on the idea of edge computing, provide innovative methods and future research directions in data optimization, adaptive learning, incentive mechanisms, and advanced technology.
百度学术
下载:
