ISSN 1000-1239 CN 11-1777/TP

• 信息处理 •

### 基于IndRNN-Attention的用户意图分类

1. (西北师范大学计算机科学与工程学院 兰州 730070) (zzc@nwnu.edu.cn)
• 出版日期: 2019-07-01
• 基金资助:
国家自然科学基金项目(61762081,61662067,61662068);甘肃省重点研发计划项目(2017GS10781)

### User Intent Classification Based on IndRNN-Attention

Zhang Zhichang, Zhang Zhenwen, Zhang Zhiman

1. (College of Computer Science and Engineering, Northwest Normal University, Lanzhou 730070)
• Online: 2019-07-01

Abstract: Recently, with the development of big data and deep learning techniques, human-computer dialogue technology has been emerged as a hot topic, which has attracted the attention from academia and industry. Massive application products based on human-computer dialogue technology appear in our lives and bring us great convenience, such as Apple Siri, Microsoft Cortana, and Huawei smart speaker. However, how to make dialogue system identify and understand user intent more accurately, is still a great challenge. This paper therefore proposes a novel method named IndRNN-Attention based on independently recurrent neural network (IndRNN) and word-level attention mechanism for user intent classification problem. Firstly, we encode the user input message text through Multi-layer IndRNN. Secondly, we use word-level attention mechanism to improve the contribution of domain-related words to encode user input message text, and generate final representation vector of the user input message text. Finally, we classify this representation vector through softmax layer and output classification result. We not only introduce the IndRNN in our approach to solve the problems of gradient vanishing and gradient explosion, but also integrate word-level attention mechanism to improve the quality of text representation. Experimental results show that the proposed IndRNN-Attention approach achieves 0.93 F\-{macro} value on the user intent classification task and outperforms the state-of-the-art approaches significantly.