基于扩展的S-LSTM的文本蕴含识别

胡超文; 邬昌兴; 杨亚连

doi:10.7544/issn1000-1239.2020.20190522

基于扩展的S-LSTM的文本蕴含识别

(华东交通大学软件学院南昌 330013) (hcwjuly@126.com)

基金项目: 国家自然科学基金项目(61866012)；江西省自然科学基金项目(20181BAB202012)；江西省教育厅科学技术研究项目(GJJ180329)

详细信息

中图分类号: TP391
计量
- 文章访问数: 1177
- HTML全文浏览量: 3
- PDF下载量: 344
出版历程
- 发布日期: 2020-06-30

Extended S-LSTM Based Textual Entailment Recognition

(School of Software, East China Jiaotong University, Nanchang 330013)

Funds: This work was supported by the National Natural Science Foundation of China (61866012), the Natural Science Foundation of Jiangxi Province of China (20181BAB202012), and the Science and Technology Research Project of Jiangxi Provincial Education Department (GJJ180329).

摘要

摘要: 文本蕴含识别旨在自动判断给定的前提和假设(通常为2个句子)之间是否存在蕴含关系，是自然语言处理领域一项基础但富有挑战的任务.当前，主流的基于深度学习的模型通常分别建模前提和假设的语义表示，而没有把它们看作一个整体；另外，在捕获它们之间的语义关系时，大都没有同时利用句子级别的全局信息和短语级别的局部信息.最近提出的S-LSTM能够同时学习句子和短语的语义表示，在文本分类等任务上取得了较好的效果.基于上述情况，提出了一种基于扩展的S-LSTM的文本蕴含识别模型.一方面，把前提和假设看作一个整体，扩展S-LSTM以同时学习它们的语义表示；另一方面，在建模语义关系时，既利用句子级别的信息又利用短语级别的信息，以此获得更好的语义表示.在英文SNLI数据集和中文CNLI数据集上的实验结果表明：提出的模型取得了比基准模型更好的识别性能.
- 文本蕴含识别 /
- 蕴含关系 /
- 语义关系 /
- 扩展的S-LSTM /
- 深度学习
Abstract: Text entailment recognition aims at automatically determining whether there is an entailment relationship between the given premise and hypothesis (usually two sentences). It is a basic and challenging task in natural language processing. Current dominant models, which are based on deep learning, usually encode the semantic representations of two sentences separately, instead of considering them as a whole. Besides, most of them do not leverage both the sentence-level global and ngram-level local information when capturing the semantic relationship. The recently proposed S-LSTM can learn semantic representations of a sentence and its ngrams simultaneously, achieving promising performance on tasks such as text classification. Considering the above, a model based on an extended S-LSTM is proposed for textual entailment recognition. On the one hand, S-LSTM is extended to learn semantic representations of the premise and hypothesis simultaneously, which regards them as a whole. On the other hand, to obtain better semantic representation, both the sentence-level and ngram-level information are used to capture the semantic relationships. Experimental results, on the English SNLI dataset and Chinese CNLI dataset, show that the performance of the proposed model is better than baselines.
- textual entailment recognition /
- entailment relationship /
- semantic relationship /
- extended S-LSTM /
- deep learning

HTML全文

参考文献(0)

施引文献(8)

期刊类型引用(5)

1.	闫庆文，郭影，刘文芬，陈文，陆永灿. 一种灵活性高的16比特S盒设计方法. 计算机技术与发展. 2025(03): 91-98 . 百度学术
2.	武小年，吴庭，黄昭文，张润莲. 基于复合混沌系统的S盒构造与优化方法. 计算机科学与探索. 2025(04): 1095-1104 . 百度学术
3.	马俊. 基于AES对称加密算法的电子商务敏感数据加密存储研究. 佳木斯大学学报(自然科学版). 2024(06): 45-48 . 百度学术
4.	武小年，豆道饶，韦永壮，张润莲，李灵琛. 基于Feistel-NFSR结构的16比特S盒设计方法. 密码学报. 2023(01): 146-154 . 百度学术
5.	武小年，舒瑞，豆道饶，张润莲，韦永壮. 基于L-M-NFSR结构的16比特S盒设计方法. 计算机科学与探索. 2023(10): 2511-2518 . 百度学术