• 中国精品科技期刊
  • CCF推荐A类中文期刊
  • 计算领域高质量科技期刊T1类
Advanced Search
Pu Yonglin, Yu Jiong, Lu Liang, Li Ziyang, Guo Binglei, Liao Bin. Energy-Efficient Strategy Based on Data Recovery in Storm[J]. Journal of Computer Research and Development, 2021, 58(3): 479-496. DOI: 10.7544/issn1000-1239.2021.20200489
Citation: Pu Yonglin, Yu Jiong, Lu Liang, Li Ziyang, Guo Binglei, Liao Bin. Energy-Efficient Strategy Based on Data Recovery in Storm[J]. Journal of Computer Research and Development, 2021, 58(3): 479-496. DOI: 10.7544/issn1000-1239.2021.20200489

Energy-Efficient Strategy Based on Data Recovery in Storm

Funds: This work was supported by the National Natural Science Foundation of China (61862060, 61462079, 61562086, 61562078), the Research Innovation Project of Graduate Student in Xinjiang Uygur Autonomous Region (XJ2019G038), and the Doctoral Innovation Program of Xinjiang University (XJUBSCX-201902).
More Information
  • Published Date: February 28, 2021
  • As one of the most popular platforms in big data stream computing, Storm is developed for high performance in the design process, which ignores the problem of high energy consumption and restricts the development of the platform. Aiming at this problem, the task allocation model, the topology information monitoring model, the data recovery model, and the energy consumption model are set up. Moreover, an energy-efficient strategy based on data recovery in Storm(DR-Storm) is proposed. The proposed strategy is composed of the throughput detection algorithm and the data recovery algorithm. According to the topology information, the throughput detection algorithm calculates cluster throughput which is feedbacked by the topology information monitoring model and estimates whether the task in cluster topology should be terminated by information feedback. The data recovery algorithm selects a backup node for data storage according to the data recovery model and estimates whether cluster topology is appropriate for data recovery by the feedback of the topology information monitoring model. In addition, the DR-Storm recovers data within the cluster topology from the memory of the backup node. We evaluate the DR-Storm by measuring the cluster latency as well as the energy consumption efficiency in a big data stream computing environment. The experimental results show that the proposed strategy can reduce cluster latency and power while the energy consumption is saved efficiently compared with existing researches.
  • Related Articles

    [1]Duan Wenxue, Hu Ming, Zhou Qiong, Wu Tingming, Zhou Junlong, Liu Xiao, Wei Tongquan, Chen Mingsong. Reliability in Cloud Computing System: A Review[J]. Journal of Computer Research and Development, 2020, 57(1): 102-123. DOI: 10.7544/issn1000-1239.2020.20180675
    [2]Sun Jian, Li Zhanhuai, Li Qiang, Zhang Xiao, Zhao Xiaonan. SSD Power Modeling Method Based on the Gradient of Energy Consumption[J]. Journal of Computer Research and Development, 2019, 56(8): 1772-1782. DOI: 10.7544/issn1000-1239.2019.20170694
    [3]Wang Jiye, Zhou Biyu, Zhang Fa, Shi Xiang, Zeng Nan, Liu Zhiyong. Data Center Energy Consumption Models and Energy Efficient Algorithms[J]. Journal of Computer Research and Development, 2019, 56(8): 1587-1603. DOI: 10.7544/issn1000-1239.2019.20180574
    [4]Lu Liang, Yu Jiong, Bian Chen, Liu Yuechao, Liao Bin, Li Huijuan. A Task Migration Strategy in Big Data Stream Computing with Storm[J]. Journal of Computer Research and Development, 2018, 55(1): 71-92. DOI: 10.7544/issn1000-1239.2018.20160812
    [5]Liao Bin, Zhang Tao, Yu Jiong, Yin Lutong, Guo Gang, Guo Binglei. Energy Consumption Modeling and Optimization Analysis for MapReduce[J]. Journal of Computer Research and Development, 2016, 53(9): 2107-2131. DOI: 10.7544/issn1000-1239.2016.20148443
    [6]Zhang Yiwen, Guo Ruifeng, Deng Changyi. Low Power Scheduling Algorithm for Mix Tasks Based on Constant Bandwidth Server[J]. Journal of Computer Research and Development, 2015, 52(9): 2094-2104. DOI: 10.7544/issn1000-1239.2015.20140611
    [7]Xu Xiaolong, Geng Weijian, Yang Geng, Li Lingjuan, Yang Zhen. An Efficient Fault-Tolerant Event and Event Boundary Detection Algorithm for Wireless Sensor Networks[J]. Journal of Computer Research and Development, 2014, 51(5): 997-1008.
    [8]Cheng Xiaoliang, Deng Zhidong, Dong Zhiran. A Model of Energy Consumption Based on Characteristic Analysis of Wireless Communication and Computation[J]. Journal of Computer Research and Development, 2009, 46(12): 1985-1993.
    [9]Han Jianjun, Gan Lu, Ruan Youlin, Li Qinghua, Abbas A.Essa. Real-Time Dynamic Scheduling Algorithms for the Savings of Power Consumption and Fault Tolerance in Multi-Processor Computing Environment[J]. Journal of Computer Research and Development, 2008, 45(4): 706-715.
    [10]Sun Dayang, Liu Yanheng, Wang Aimin. An Aggregation Tree Constructing Algorithm Based on Energy Consumption Assessment[J]. Journal of Computer Research and Development, 2008, 45(1): 104-109.
  • Cited by

    Periodical cited type(3)

    1. 蒲勇霖,许小龙,于炯,李梓杨,国冰磊. 流式大数据平台下的弹性数据迁移能效优化策略. 通信学报. 2024(02): 188-200 .
    2. 刘智臣. 一种基于物联网数据采集的农业大数据生产决策系统探究. 南方农机. 2022(06): 35-38 .
    3. 蒲勇霖,于炯,鲁亮,李梓杨,卞琛,廖彬. Storm平台下的线程重分配与数据迁移节能策略. 软件学报. 2021(08): 2557-2579 .

    Other cited types(1)

Catalog

    Article views (713) PDF downloads (338) Cited by(4)

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return