ISSN 1000-1239 CN 11-1777/TP

计算机研究与发展 ›› 2020, Vol. 57 ›› Issue (11): 2348-2374.doi: 10.7544/issn1000-1239.2020.20190793

• 图形图像 • 上一篇    下一篇

自动图像标注技术综述

马艳春,刘永坚,解庆,熊盛武,唐伶俐   

  1. (武汉理工大学计算机科学与技术学院 武汉 430070) (mayanchun@whut.edu.cn)
  • 出版日期: 2020-11-01
  • 基金资助: 
    国家自然科学基金项目(61602353);中央高校基本科研业务费专项资金(WUT:2017YB028)

Review of Automatic Image Annotation Technology

Ma Yanchun, Liu Yongjian, Xie Qing, Xiong Shengwu, Tang Lingli   

  1. (School of Computer Science and Technology, Wuhan University of Technology, Wuhan 430070)
  • Online: 2020-11-01
  • Supported by: 
    This work was supported by the National Natural Science Foundation of China (61602353) and the Fundamental Research Funds for the Central Universities (WUT:2017YB028).

摘要: 图像自动标注技术是减少图像数据与内容之间“语义鸿沟”的其中一种最有效途径,对于帮助人类理解图像内容,从海量图像数据中检索感兴趣的信息具有重要现实意义.通过研究近20年公开发表的图像标注文献,总结了图像标注模型的一般性框架;并通过该框架结合各种具体工作,分析出在图像标注研究过程中需要解决的一般性问题;将各种图像标注模型所采用的主要方法归为9种类型,分别为相关模型、隐Markov模型、主题模型、矩阵分解模型、近邻模型、基于支持向量机的模型、图模型、典型相关分析模型以及深度学习模型,并对每种类型的图像标注模型,按照“基本原理介绍—具体模型差异—模型总结”3个层面进行了研究与分析.此外,总结了图像标注模型常用的一些数据集、评测指标,对一些比较著名的标注模型的性能进行了比较,并据此对各种类型的标注模型做了优缺点分析.最后,提出了图像标注领域一些开放式问题和研究方向.

关键词: 自动图像标注, 图像语义分析, 图像标识, 图像内容标签, 图像内容标注

Abstract: As one of the most effective ways to reduce the “semantic gap” between image data and its content, automatic image annotation (AIA) technology has shown its great significance to help people understand image contents and retrieve the target information from the massive image data. This paper summarizes the general framework of AIA models by investigating the literatures about image annotation in recent 20 years, and analyzes the general problems to solve in AIA problems by combining the framework with various specific works. In this paper, the main methods used in various AIA models are classified into 9 types: correlation model, hidden Markov model, topic model, matrix factorization model, neighbor-based model, SVM-based model, graph-based model, CCA (KCCA) model and deep learning model. For each type of image annotation model, this paper provides a detailed study and analysis in terms of “basic principle introduction-specific model differences-model summary”. In addition, this paper summarizes some commonly used datasets and evaluation indexes, and compares the performance of some important image annotation models with related analysis on the advantages and disadvantages of various types of AIA models. Finally, some open problems and research directions in the field of image annotation are proposed and suggested.

Key words: automatic image annotation, image semantic analysis, image tagging, image content label, image content annotation

中图分类号: