• 中国精品科技期刊
  • CCF推荐A类中文期刊
  • 计算领域高质量科技期刊T1类
Advanced Search
Li Qian, Hu Yupeng, Ye Zhenyu, Xiao Ye, Qin Zheng. An Ant Colony Optimization Algorithms Based Data Update Scheme for Erasure-Coded Storage Systems[J]. Journal of Computer Research and Development, 2021, 58(2): 305-318. DOI: 10.7544/issn1000-1239.2021.20200383
Citation: Li Qian, Hu Yupeng, Ye Zhenyu, Xiao Ye, Qin Zheng. An Ant Colony Optimization Algorithms Based Data Update Scheme for Erasure-Coded Storage Systems[J]. Journal of Computer Research and Development, 2021, 58(2): 305-318. DOI: 10.7544/issn1000-1239.2021.20200383

An Ant Colony Optimization Algorithms Based Data Update Scheme for Erasure-Coded Storage Systems

Funds: This work was supported by the National Natural Science Foundation of China (61872130, 61572181), the Science and Technology Project of Hunan Provincial Department of Communications(201928), and the Key Research and Development Program of Changsha (kq1907103).
More Information
  • Published Date: January 31, 2021
  • Owing to the high availability and space-efficiency of erasure codes, they have become the de facto standard to provide data durability in large scale distributed storage systems. The update intensive workloads of erasure codes lead to a large amount of data transmission and I/O cost. As a result, it becomes a major challenge to reduce the amount of data transmission and optimize the use of existing network resources so that the update efficiency of the erasure codes could be improved. However, very little research has been done to optimize the update efficiency of the erasure codes under multiple QoS(quality of service) metrics. In this paper, the proposed update scheme, the ACOUS (ant colony optimization algorithm based multiple data nodes update scheme) employs a two-stage rendezvous data update procedure to optimize the multiple data nodes updates. Specifically, the two-stage rendezvous data update procedure performs the data delta collection and the parity delta distribution efficiently, based on a multi-objective update tree which is built by the MACOU(multi-objective ant colony optimization update routing algorithm). Under typical data center network topologies, extensive experimental results show that, compared with the traditional TA-Update scheme, the proposed scheme is able to achieve 26% to 37% reduction of update delay with convergence guarantee at the cost of negligible computation overhead.
  • Related Articles

    [1]Xie Wenbing, Guan Ruixue, Zhang Yiming, Li Jiamei, Wang Jun. Efficient Optimization of Erasure Coding for Storage Library[J]. Journal of Computer Research and Development. DOI: 10.7544/issn1000-1239.202440091
    [2]Zhang Zilin, Liu Duo, Tan Yujuan, Wu Yu, Luo Longpan, Wang Weilüe, Qiao Lei. An Erasure-Coded Data Update Method for Distributed Storage Clusters[J]. Journal of Computer Research and Development, 2022, 59(11): 2451-2466. DOI: 10.7544/issn1000-1239.20210211
    [3]Zhang Yao, Chu Jiajia, Weng Chuliang. Survey on Data Updating in Erasure-Coded Storage Systems[J]. Journal of Computer Research and Development, 2020, 57(11): 2419-2431. DOI: 10.7544/issn1000-1239.2020.20190675
    [4]Wang Wenhua, Wang Tian, Wu Qun, Wang Guojun, Jia Weijia. Survey of Delay-Constrained Data Collection with Mobile Elements in WSNs[J]. Journal of Computer Research and Development, 2017, 54(3): 474-492. DOI: 10.7544/issn1000-1239.2017.20150953
    [5]Deng Xiaoheng, Cao Dejuan, Pan Yan, Shen Hailan, Chen Zhigang. An Optimized Credit Distribution Model in Social Networks with Time-Delay Constraint[J]. Journal of Computer Research and Development, 2017, 54(2): 382-393. DOI: 10.7544/issn1000-1239.2017.20151118
    [6]Wang Zhanfeng, Chen Ming, Xing Changyou, Bai Huali, and Wei Xianglin. TIV and Access Delay in the Internet Delay Space[J]. Journal of Computer Research and Development, 2013, 50(3): 509-516.
    [7]Yang Zhenguo, Huang Liusheng, Xiao Mingjun, Huang He, Zhang Yindong, Zhu Youwen. ACR:An Ant-Colony-based Routing in Delay Tolerant Networks[J]. Journal of Computer Research and Development, 2012, 49(12): 2501-2514.
    [8]Wang Wei, Yang Ming, Luo Junzhou, and Wu Wenjia. Modeling and Analysis of Multicast Delay in Network Coding-Based Multi-Radio Wireless Mesh Networks[J]. Journal of Computer Research and Development, 2012, 49(6): 1174-1184.
    [9]Zhou Ling, Sun Yamin. A DelayConstrained Steiner Tree Algorithm Using MPH[J]. Journal of Computer Research and Development, 2008, 45(5): 810-816.
    [10]Yang Hongyong, Kong Xiangxin, Zhang Fuzeng. Stability of an AQM Control Algorithm with Communication Delays[J]. Journal of Computer Research and Development, 2005, 42(7): 1123-1127.
  • Cited by

    Periodical cited type(9)

    1. 王晖,赵咨钧,管保晋,曲诺亚. 光伏发电机组异动信息主动增量式更新算法. 电子设计工程. 2025(01): 132-136 .
    2. 翁锦阳,朱铁兵,柏志安. 基于密度划分的分布式数据容错存储算法研究. 吉林大学学报(信息科学版). 2024(01): 67-73 .
    3. 陈占伟,胡晓. 基于MEC边缘云的智慧商城数据更新控制算法. 计算机仿真. 2024(02): 477-481 .
    4. 崔建军,董馨. 基于分段拟合压缩的多源数据容灾存储算法. 电子设计工程. 2024(08): 64-67+72 .
    5. 江再玉,苑学贺,庞帆,黄海,吴嘉生,马崇瑞. 云平台网络节点单体监控信息分布式存储方法. 微型电脑应用. 2024(05): 219-222 .
    6. 华琴,赵刚. 基于自适应寻优控制和多目标学习参数模型的AI人工智能翻译研究. 自动化与仪器仪表. 2024(09): 33-38 .
    7. 吉汝哲,夏磊. 密集非稳状态时间下机械液压立体停车装置高精度控制方法. 机械制造与自动化. 2024(06): 234-238+243 .
    8. 赵银瑞,殷双飞,陕振,王梓斌. 基于树结构的纠删码数据更新策略. 计算机工程与设计. 2023(03): 725-731 .
    9. 刘好斌,梁旗军,肖鹏. 软件可靠性耦合度量的测试用例约简优化. 计算机仿真. 2023(09): 381-384+405 .

    Other cited types(6)

Catalog

    Article views (695) PDF downloads (369) Cited by(15)

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return