高级检索
    戴宏, 盛立杰, 苗启广. 基于胶囊网络的对抗判别域适应算法[J]. 计算机研究与发展, 2021, 58(9): 1997-2012. DOI: 10.7544/issn1000-1239.2021.20200569
    引用本文: 戴宏, 盛立杰, 苗启广. 基于胶囊网络的对抗判别域适应算法[J]. 计算机研究与发展, 2021, 58(9): 1997-2012. DOI: 10.7544/issn1000-1239.2021.20200569
    Dai Hong, Sheng Lijie, Miao Qiguang. Adversarial Discriminative Domain Adaptation Algorithm with CapsNet[J]. Journal of Computer Research and Development, 2021, 58(9): 1997-2012. DOI: 10.7544/issn1000-1239.2021.20200569
    Citation: Dai Hong, Sheng Lijie, Miao Qiguang. Adversarial Discriminative Domain Adaptation Algorithm with CapsNet[J]. Journal of Computer Research and Development, 2021, 58(9): 1997-2012. DOI: 10.7544/issn1000-1239.2021.20200569

    基于胶囊网络的对抗判别域适应算法

    Adversarial Discriminative Domain Adaptation Algorithm with CapsNet

    • 摘要: 关于域适应算法的研究显示了对抗性学习填补源域和目标域间差异的有效性,但仍存在其局限性,即仅从2个域抽取的样本不足以保证大部分潜在空间的域不变性.注意到胶囊网络(capsule network, CapsNet)在捕获样本的表征不变性上具有较强的能力,通过结合二者得到了一种新的域适应学习算法.首先,提出了胶囊层卷积算法,并结合残差结构,使得训练更深的胶囊网络成为可能.实验表明,这种新的胶囊网络架构能够在捕获浅层特征时取得更佳的效果.其次,传统的对抗判别域适应算法使用的卷积基容易不加分辨地模糊源域与目标域的界限,进而造成判别效果的下降.因此,在VAE-GAN(variational auto-encoder, generative adversarial networks)的启发下,通过引入重建网络作为强约束,巧妙地利用了胶囊网络可调整为自编码器的特性,使得对抗判别域适应网络能够在卷积基进行迁移时,克服传统对抗判别域适应算法易发生模式崩塌的固有缺陷,保证判别器对源域与目标域内样本共性表征的敏感度.实验表明,该方法可以在不同复杂程度的域适应任务中取得较好的性能,并在关键标准数据集上取得了最先进的成果.

       

      Abstract: Recently, studies on domain adaptation have shown the effectiveness of adversarial learning in filling the differences between two domains, but there are still some limitations that samples taken from two domains are not enough to keep the domain invariance in potential spaces. Inspired by the fact that CapsNet(capsule network) has a strong ability to extract the invariance of features from samples, we introduce it into the domain adaptation problem. Firstly, a new convolution algorithm is devised over capsule-layer, combined with residual block, which makes it possible to train a deeper CapsNet. Results demonstrate that this new structure of CapsNet has a stronger ability to extract features. Secondly, the traditional adversarial discriminative adaptation methods have the defect that prones to blur the boundary between different domains, which in turn leads to a decline in the discriminative performance. Inspired by VAE-GAN(variational auto-encoder, generative adversarial networks), we use a reconstruction network as a strong constraint, so that the adversarial discriminative network avoids the inherent defect of mode collapse when the convolution base is transferring, and ensures that the discriminator is sensitive to the invariance of representation in different domains. Experiments on standard datasets show that our model achieves better performance in domain adaptation tasks of varying complexity.

       

    /

    返回文章
    返回