Training Deep Neural Networks for Image Applications with Noisy Labels by Complementary Learning
-
摘要: 近几年来，深度神经网络在图像识别、语音识别、自然语言处理等众多领域取得了突破性的进展.互联网以及移动设备的快速发展极大地推进了图像应用的普及，也为深度神经网络的训练积累了大量数据.其中，大规模人工标注的数据是成功训练深度神经网络的关键.但随着数据规模的快速增长，人工标注图像的成本也越来越高，同时不可避免地产生标注错误，从而影响神经网络的训练.为此，提出了一种称为互补学习的方法，面向图像应用中深度神经网络的训练，将简单样本挖掘和迁移学习的思想相结合，利用少量人工标注的干净数据和大量带有噪声标注的数据，同时训练一主一辅2个深度神经网络模型，在训练过程中采用互补的策略分别选择部分样本进行学习，同时将辅模型的知识迁移给主模型，从而减少噪声标注对训练的影响.实验表明：提出的方法能有效地利用带有噪声标注的数据训练深度神经网络，并对比其他方法有一定的优越性，有较强的应用价值.Abstract: In recent years, deep neural networks (DNNs) have made great progress in many fields such as image recognition, speech recognition and natural language processing, etc. The rapid development of the Internet and mobile devices promotes the popularity of image applications and provides a large amount of data to be used for training DNNs. Also, the manually annotated data is the key of training DNNs. However, with the rapid growth of data scale, the cost of manual annotation is getting higher and the quality is hard to be guaranteed, which will damage the performance of DNNs. Combining the idea of easy example mining and transfer learning, we propose a method called complementary learning to train DNNs on large-scale noisy labels for image applications. With a small number of clean labels and a large number of noisy labels, we jointly train two DNNs with complementary strategies and meanwhile transfer the knowledge from the auxiliary model to the main model. Through experiments we show that this method can efficiently train DNNs on noisy labels. Compared with current approaches, this method can handle more complicated noise labels, which demonstrates its value for image applications.
-
计量
- 文章访问数: 1684
- HTML全文浏览量: 2
- PDF下载量: 757
下载:
