ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2021, Vol. 58 ›› Issue (12): 2724-2747.doi: 10.7544/issn1000-1239.2021.20200699

Previous Articles     Next Articles

Survey on Deep Learning Based Crowd Counting

Yu Ying1, Zhu Huilin1, Qian Jin1, Pan Cheng1, Miao Duoqian1,2   

  1. 1(School of Software, East China Jiaotong University, Nanchang 330013);2(College of Electronics and Information Engineering, Tongji University, Shanghai 201804)
  • Online:2021-12-01
  • Supported by: 
    This work was supported by the National Natural Science Foundation of China (62163016, 62066014) and the Natural Science Foundation of Jiangxi Province (20212ACB202001, 20202BABL202018).

Abstract: Crowd counting, aiming to estimate the number, density or distribution of crowds in images or videos, belongs to the research category of object counting. It has been widely employed in crowd behavior analysis and public safety management to detect crowding or abnormal behavior in time to avoid accidents. In the past decades, although tremendous efforts have been made to enhance the performance of crowd counting algorithms, some long-standing challenges, such as cross-scene counting, perspective distortion and scale variation, remain unresolved. Along this line, an emerging research trend is to exploit the deep learning technologies for crowd counting. It has been proven to be an effective way to address the above issues. In this paper, crowd counting models based on deep learning are reviewed, analyzed, and discussed. Firstly, crowd counting models are introduced in details from the perspective of their principles, steps, and model variants, and the difference between the crowd counting models based on traditional methods and the crowd counting models based on deep learning are analyzed. Then the research status of crowd counting based on deep learning are expounded from four aspects: network structure, ground-truth generation, loss function and evaluation index. Meanwhile, the characteristics of various crowd counting data sets are compared and analyzed. Finally, some future directions of crowd counting are given.

Key words: crowd counting, density map estimation, multi-scale, deep learning, convolutional neural network (CNN)

CLC Number: