ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2020, Vol. 57 ›› Issue (5): 1046-1056.doi: 10.7544/issn1000-1239.2020.20190287

Previous Articles     Next Articles

Detection of Persistent Elements in Distributed Monitoring System

Lu Le1, Sun Yu’e 2,3, Huang He 1,3, Wang Runzhi1, Cao Zhen1   

  1. 1( School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215131);2( School of Rail Transportation, Soochow University, Suzhou, Jiangsu 215137);3( Suzhou Institute for Advanced Study, University of Science and Technology of China, Suzhou, Jiangsu 215123)
  • Online:2020-05-01
  • Supported by: 
    This work was supported by the General Program of the National Natural Science Foundation of China (61672369, 61873177, 61572342).

Abstract: The detection of persistent elements has many important applications in the fields of detecting intrusions in a distributed system, finding common interests, measuring the traffic, etc. Most of the existing state-of-the-art studies of detecting persistent elements have some problems such as false or missing report, high communication cost and great limitation so that they can hardly satisfy the requirement of some distributed applications. To solve these problems, the paper proposes a scheme to detect persistent elements in distributed monitoring system with the goal of minimizing the total communication cost during the whole detection process. First, the scheme filters out most of the irrelevant elements to reduce the overall communication overhead through multiple rounds of compressed data transferring between all monitors and the central coordinator. Then, we ensure that each round of the filtering is necessary and can achieve the best performance by adjusting parameters of filtering according to the theoretical analysis and derivation. With the technology of extended Bloom filter and the persistent spread estimation function, the scheme can work well no matter in the balanced environment or in the unbalanced environment. Finally, we perform extensive simulations to study the performance of the proposed mechanism, and the simulation results show the effectiveness of our scheme.

Key words: distributed system, persistent element, Bloom filter, communication cost minimization, mechanism design

CLC Number: