高级检索

    一种鲁棒高精度的人脸三维运动跟踪算法

    A Robust and High Accurate 3D Facial Motion Tracking Algorithm

    • 摘要: 提出了一种在粒子滤波框架下的结合在线外观模型(online appearance model, OAM)和柱状人头模型(cylinder head model, CHM)的人脸三维运动跟踪方案,具体包括:1)融合多种观测信息来降低OAM的光照敏感性和个体相关性;2)针对OAM适合跟踪局部运动但在大姿态下会跟踪失败的问题,将OAM与适合于大姿态下全局运动跟踪的CHM结合起来,在当前帧将CHM匹配得到的全局运动参数作为OAM匹配的初始值,将OAM匹配得到的人脸运动参数作为下一帧CHM匹配的初始值;3)基于局部优化和改进重采样来改进粒子运动滤波策略.实验表明:该系统在大姿态、表情剧烈变化、遮挡和强光照下能得到较好的跟踪效果,且OAM+CHM的跟踪正确率高于OAM的24%,OAM+CHM的姿态跟踪范围大于OAM的11%.主观实验表明:由跟踪得到的人脸运动参数合成的虚拟人脸具有较高的辨识度.

       

      Abstract: A 3D facial motion tracking approach is proposed based on the incorporation of online appearance model (OAM) and cylinder head model (CHM) in framework of particle filter. It includes: 1) For the construction of OAM, multi-measurements are infused to reduce the influence of lighting and person dependence. 2) OAM can provide the detailed descriptive parameters used for facial motion tracking, however, it is not suitable for robust facial motion tracking across large pose variation. To alleviate these problems, OAM and CHM which is suitable for robust global head motion tracking across large pose variation, are combined, where the global head motion parameters obtained from the CHM are used as the cues of the OAM parameters for a good fitting. And the good fitting result is set as the initial of CHM in next frame. 3) Motion filtering is applied by particle filter combined with local optimization and improved resampling. Experiments of tracking real video sequences demonstrate that accurate tracking is obtained even in the presence of perturbing factors including significant head pose and facial expression variations, occlusions, and illumination changes. And it is also shown that facial motion tracking combining OAM and CHM is more pose robust than that of OAM in terms of 24% higher tracking rate and 11% wider pose coverage. The between subjective experiment indicates the suitability of subjective face identification on synthesized video with tracked facial motion parameters by it.

       

    /

    返回文章
    返回