高级检索

    基于异构算力节点协同的高效视频分发

    Efficient Video Distribution Based on Collaboration of Heterogenous Computing Nodes

    • 摘要: 算力网络通过网络连接计算节点以突破单点算力限制,近年来正快速发展应用于越来越多的业务领域. 当前流行的视频直播依赖于大量视频帧传输和转码处理,探索算力网络实现高效视频分发具有重要的现实意义. 相比于传统的大规模数据处理,视频类应用对于传输时延和带宽的保障有更高要求. 然而当前各云服务提供的节点算力各不相同,同时节点间网络链路状态经常变化不定,使选择传输和转码综合性能最优节点实现低时延、高带宽的视频分发面临很大挑战. 为此,设计基于异构算力节点协同的高效视频分发方案,包括通过强化学习规划视频传输路径并合理选取处理转码节点;对不同视频分发任务采用优先级排队调度同时自适应调整资源以降低对节点资源的突发竞争;采用分层日志同步容错机制在节点故障后快速恢复数据一致性,最终部署多云服务分布式节点实现一个完整的视频分发系统. 大量超高清视频直播实验表明,该方案性能相比现有视频分发方法有明显改进.

       

      Abstract: Computing power network connects computing nodes through the network to break the limitation of single point of computing power, and it is rapidly developed and applied in more and more business fields in recent years. The popular live video broadcasting relies on the transmission and transcoding of a large number of video frames, and it is of great practical importance to explore computing power networks for efficient video distribution. Compared with the traditional large-scale data processing, video applications have higher requirements for transmission delay and bandwidth guarantee. However, the computing power of nodes provided by each cloud service varies, and the state of network links between nodes often varies. Therefore, it is a great challenge to realize low latency and high bandwidth video distribution by selecting nodes with the best combined transmission and transcoding performance. Therefore, we design an efficient video distribution scheme based on heterogeneous computing nodes, including planning video transmission paths and reasonably selecting transcoding nodes through reinforcement learning, using priority queuing scheduling for different video distribution tasks and adaptively adjusting node resources to reduce resource bursty competition, adopting a layered-log-synchronization fault tolerance mechanism to quickly restore data consistency after node failures, and finally deploying multi-cloud service distributed nodes to realize a complete video distribution system. A large number of live ultra-high definition video experiments show that the performance of this scheme is significantly improved compared with existing video distribution methods.

       

    /

    返回文章
    返回