高级检索

    二次解耦与活体特征渐进式对齐的域自适应人脸反欺诈

    Domain Adaptation for Face Anti-Spoofing Based on Dual Disentanglement and Liveness Feature Progressive Alignment

    • 摘要: 现有的人脸反欺诈(face anti-spoofing,FAS)方法虽然在域内测试表现良好,但在跨域场景下性能会大幅度下降. 当前基于域对抗对齐的跨域人脸反欺诈方法,因其对齐网络和分类网络彼此独立,无法保证对齐任务直接服务于分类任务. 提出了一种基于二次解耦与活体特征课程学习渐进式对抗对齐的域自适应人脸反欺诈(domain adaptation for face anti-spoofing based on dual disentanglement and liveness feature curriculum learning progressive adversarial alignment,DDCL)方法,首先将源域特征启发式解耦为域相关特征和域无关特征,之后使用分类器的梯度信息将域无关特征中的活体相关和无关特征进行第2次解耦. 在训练过程中为减轻优化难度,通过课程学习的方式对目标域特征与活体相关、无关特征的组合进行渐进式对抗对齐,逐步提高活体相关特征的比重,增强目标域特征与活体检测任务的相关性,从因果角度给出活体对齐域自适应的解释. 在CASIA-MFSD,Idiap Replay-Attack,MSU-MFSD与OULU-NPU公开数据集上的实验结果表明,与现有10种方法相比,所提出的方法获得了22.5%的最佳平均HTER值,并在4个测评协议上均达到了当前先进水平,尤其是I-M和O-M测评协议的HTER值分别达到了12.4%和12.8%,能显著降低模型在目标域上的错误率,具有更好的跨域泛化能力.

       

      Abstract: Although existing face anti-spoofing methods perform well in intra-domain testing, their performance significantly degrades in cross-domain scenarios. Current cross-domain face anti-spoofing methods based on domain adversarial alignment cannot guarantee that the alignment task directly serves the classification task since the alignment and classification networks are independent of each other. We propose a domain adaptation for face anti-spoofing method based on domain invariant liveness features dual disentanglement and progressive adversarial alignment. Firstly, the source domain features are heuristically disentangled into domain specific features and domain invariant features. Then, the gradient of classifier is used to perform a second disentanglement of the live-related and live-unrelated features in the domain invariant features. To alleviate optimization difficulties during training, a curriculum learning method is adopted to progressively align target domain features and the combination of live-related and live-unrelated features, gradually increasing the proportion of live-related features, and enhancing the correlation between the target domain features and face anti-spoofing task. From a causal perspective, we provide an explanation for the liveness alignment domain adaptation. Experimental results on CASIA-MFSD, Idiap Replay-Attack, MSU-MFSD, and OULU-NPU datasets demonstrate that the proposed method achieves the best average HTER value of 22.5% compared with ten existing methods and the current state-of-the-art performance on four evaluation protocols. Especially the HTER values of I-M and O-M evaluation protocols achieve 12.4% and 12.8%, respectively. The proposed method can significantly reduce the error rates of the model in the target domain and has better cross-domain generalization ability.

       

    /

    返回文章
    返回