ISSN 1000-1239 CN 11-1777/TP

计算机研究与发展 ›› 2017, Vol. 54 ›› Issue (8): 1804-1812.doi: 10.7544/issn1000-1239.2017.20170182

所属专题: 2017人工智能前沿进展专题

• 人工智能 • 上一篇    下一篇

基于神经网络特征的句子级别译文质量估计

陈志明,李茂西,王明文   

  1. (江西师范大学计算机信息工程学院 南昌 330022) (qqchenzhiming@jxnu.edu.cn)
  • 出版日期: 2017-08-01
  • 基金资助: 
    国家自然科学基金项目(61462044,61662031,61462045)

Sentence-Level Machine Translation Quality Estimation Based on Neural Network Features

Chen Zhiming, Li Maoxi, Wang Mingwen   

  1. (School of Computer Information Engineering, Jiangxi Normal University, Nanchang 330022)
  • Online: 2017-08-01

摘要: 机器翻译质量估计是自然语言处理中的一个重要任务,与传统的机器翻译自动评价方法不同,译文质量估计方法评估机器译文的质量不使用人工参考译文.针对目前句子级别机器译文质量估计特征提取严重依赖语言学分析导致泛化能力不足,并且制约着后续支持向量回归算法的性能,提出了利用深度学习中上下文单词预测模型和矩阵分解模型提取句子向量特征,并将其与递归神经网络语言模型特征相结合来提高译文质量自动估计与人工评价的相关性.在WMT’15和WMT’16译文质量估计子任务数据集上的实验结果表明:利用上下文单词预测模型提取句子向量特征的方法性能统计一致地优于传统的QuEst方法和连续空间语言模型句子向量特征提取方法,这揭示了提出的特征提取方法不仅不需要语言学分析,而且显著地提高了译文质量估计的效果.

关键词: 机器翻译质量估计, 句子级别, 词向量, 递归神经网络语言模型, 支持向量回归

Abstract: Machine translation quality estimation is an important task in natural language processing. Unlike the traditional automatic evaluation of machine translation, the quality estimation evaluates the quality of machine translation without human reference. Nowadays, the feature extraction approaches of sentence-level quality estimation depend heavily on linguistic analysis, which leads to the lack of generalization ability and restricts the system performance of the subsequent support vector regression algorithm. In order to solve this problem, we extract sentence embedding features using context-based word prediction model and matrix decomposition model in deep learning, and enrich the features with recurrent neural network language model feature to further improve the correlation between the automatic quality estimation approach and human judgments. The experimental results on the datasets of WMT’15 and WMT’16 machine translation quality estimation subtasks show that the system performance of extracting the sentence embedding features by the context-based word prediction model is better than the traditional QuEst method and the approach that extracts sentence embedding features by the continuous space language model, which reveals that the proposed feature extraction approach can significantly improve the system performance of machine translation quality estimation without linguistic analysis.

Key words: machine translation quality estimation, sentence-level, word embedding, recurrent neural network language model, support vector regression

中图分类号: