Lai Xinyu, Chen Si, Yan Yan, Wang Dahan, Zhu Shunzhi. Survey on Deep Learning Based Facial Attribute Recognition Methods[J]. Journal of Computer Research and Development, 2021, 58(12): 2760-2782. DOI: 10.7544/issn1000-1239.2021.20200870
Citation:
Lai Xinyu, Chen Si, Yan Yan, Wang Dahan, Zhu Shunzhi. Survey on Deep Learning Based Facial Attribute Recognition Methods[J]. Journal of Computer Research and Development, 2021, 58(12): 2760-2782. DOI: 10.7544/issn1000-1239.2021.20200870
Lai Xinyu, Chen Si, Yan Yan, Wang Dahan, Zhu Shunzhi. Survey on Deep Learning Based Facial Attribute Recognition Methods[J]. Journal of Computer Research and Development, 2021, 58(12): 2760-2782. DOI: 10.7544/issn1000-1239.2021.20200870
Citation:
Lai Xinyu, Chen Si, Yan Yan, Wang Dahan, Zhu Shunzhi. Survey on Deep Learning Based Facial Attribute Recognition Methods[J]. Journal of Computer Research and Development, 2021, 58(12): 2760-2782. DOI: 10.7544/issn1000-1239.2021.20200870
1(School of Computer and Information Engineering, Xiamen University of Technology, Xiamen, Fujian 361024)
2(Fujian Key Laboratory of Pattern Recognition and Image Understanding(Xiamen University of Technology), Xiamen, Fujian 361024)
3(School of Informatics, Xiamen University, Xiamen, Fujian 361005)
Funds: This work was supported by the General Program of the National Natural Science Foundation of China (62071404, 61773325), the General Program of the Natural Science Foundation of Fujian Province (2021J011185, 2020J01001), the Science and Technology Planning Project of Fujian Province (2020H0023), and the Youth Innovation Foundation of Xiamen City (3502Z20206068).
Facial attribute recognition is one of the most popular research topics in computer vision and pattern recognition, and has great research significance of analyzing and understanding facial images. At the same time, it has a wide range of practical application value in many fields such as image retrieval, face recognition, micro-expression recognition and recommendation system. With the rapid development of deep learning, a large number of deep learning based facial attribute recognition (termed DFAR) methods have been put forward by domestic and foreign scholars. First the overall process of the facial attribute recognition method is described. Then, according to the different mechanisms of model construction, the part-based and holistic DFAR methods are reviewed and discussed in detail, respectively. Specifically, the part-based DFAR methods are classified according to whether or not to adopt the regular area localization technique, while the holistic DFAR methods are distinguished from the perspectives of single-task learning and multi-task learning, where multi-task learning based DFAR methods are further subdivided according to whether the attribute grouping strategy is used. Next, several popular databases and evaluation metrics on facial attribute recognition are introduced, and the performance of the state-of-the-art DFAR methods is compared and analyzed. Finally, the future research directions of the DFAR methods are provided.