ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2018, Vol. 55 ›› Issue (7): 1539-1547.doi: 10.7544/issn1000-1239.2018.20170507

Previous Articles     Next Articles

Question Similarity Calculation Based on Key Information

Qi Le, Zhang Yu, Liu Ting   

  1. (Research Center for Social Computing and Information Retrieval, Harbin Institute of Technology, Harbin 150001)
  • Online:2018-07-01

Abstract: Question similarity calculation is a major task in community question answering (CQA). It is helpful to retrieve relevant question-answer pairs from QA community by leveraging the similarity among queries. Questions in CQA are usually composed of topics and descriptions, which are both important in the task of question similarity calculation. In addition, due to the openness of the CQA, the length of questions is different. Meanwhile, background information of the questions will interfere with the judgment on question similarity. In order to reduce the influence of the irrelevant content and the various length of questions, the keywords are extracted from the descriptions of questions. Then, the keywords are fed to the CNN-based model to extract the similar and dissimilar information between texts. At the same time, in order to make better use of the information about the question topic, the model also combines the feature from the similarity between them. In summary, the model treats the keywords and topics as the key information about the questions, and uses the information to calculate similarity between them. The model is experimented on the question similarity task of the SemEval2017. The mean average precision (MAP) reaches 49.65%, which exceeds the best result in the evaluation.

Key words: question similarity, community question answering (CQA), keywords, question topic, convolutional neural network (CNN)

CLC Number: