基于文档的对话研究

孙润鑫; 马龙轩; 张伟男; 刘挺

doi:10.7544/issn1000-1239.2021.20200634

基于文档的对话研究

(哈尔滨工业大学社会计算与信息检索研究中心哈尔滨 150001) (rxsun@ir.hit.edu.cn)

基金项目: 国家自然科学基金项目(62076081，61772153，61936010)；2030新一代人工智能重大项目(2020AAA0108605)

详细信息

中图分类号: TP391
计量
- 文章访问数: 571
- HTML全文浏览量: 5
- PDF下载量: 216
出版历程
- 发布日期: 2021-08-31

Research on Document Grounded Conversations

(Research Center for Social Computing and Information Retrieval, Harbin Institute of Technology, Harbin 150001)

Funds: This work was supported by the National Natural Science Foundation of China (62076081, 61772153, 61936010) and 2030 Major Project of New Generation Artificial Intelligence of China (2020AAA0108605).

摘要

摘要: 基于文档的对话是目前对话领域一个新兴的热点任务.与以往的任务不同，其需要将对话信息和文档信息综合进行考虑.然而，先前的工作着重考虑二者之间的关系，却忽略了对话信息中的句子对回复生成的作用具有差异性.针对这一问题，提出了一种新的辩证看待对话历史的方法，在编码阶段讨论利用历史和忽略历史2种情况进行语义信息的建模，并采用辩证整合的方式进行分支信息的汇总.由此避免了在历史信息与当前对话不相关时，其作为噪声被引入进而损害模型性能，同时也强化了当前对话对信息筛选的指导作用.实验结果表明，该模型与现有基线模型相比，能够生成更为符合当前语境且信息量更加丰富的回复，从而说明其能够更好地理解对话信息并进行知识筛选.并且通过进行消融实验，也验证了各模块在建模过程中的有效性.
- 基于文档的对话 /
- 回复生成 /
- 信息筛选 /
- Transformer模型 /
- 注意力机制
Abstract: Document grounded conversations is an emerging hot task in the field of dialogue system. Different from previous tasks, it needs to consider both the utterances and the given document. However, previous work focused on the relationship between the two, but ignored the utterances’ difference in the effect of response generation. To solve this problem, a new dialectical approach to the dialogue history, which means the utterances before the last one, is proposed in this paper. At the encoding step, it divides the modeling of the semantic information into two parts: using history and ignoring history, and then uses the comparative integration method to summarize the branch results. In this way, when the dialogue history is not related to the current utterance, it can avoid being introduced as noise which will damage the performance of the model. Besides, it also strengthens the guiding role of the current utterance in the information filtering process. Experimental results show that compared with the existing baselines, this model can generate responses that are more in line with the current context and more informative, indicating that it can better understand dialogue information and conduct knowledge filtering. And through the ablation study, the effectiveness of each module in the modeling process is also verified.
- document grounded conversations /
- reply generation /
- information filtering /
- Transformer model /
- attention mechanism

HTML全文

参考文献(0)

施引文献(14)

期刊类型引用(9)

1.	潘海霞，曹宁. 面向无线网络的数据传输自适应拥塞控制. 自动化与仪器仪表. 2024(01): 75-78+84 . 百度学术
2.	江宝英，廖锋. 基于云计算的多媒体网络数据传输拥塞控制方法. 长江信息通信. 2024(11): 96-98 . 百度学术
3.	吴欣. 基于流媒体技术的医学档案信息资源数字化传输. 微型电脑应用. 2023(08): 213-216 . 百度学术
4.	朱振伸，范黎林，赵敬云. 多媒体网络中基于QoS的自适应SPC仿真. 计算机仿真. 2022(01): 213-217 . 百度学术
5.	范洁，谢鑫，陈战胜. 关键姿态映射下视频动态帧目标定位方法. 计算机仿真. 2022(03): 156-159+248 . 百度学术
6.	王健，王仲宇，朱文凯，孙洁茹，潘瑞娟，陈晓宁. 基于可穿戴设备的无线组网输液监控系统. 传感器与微系统. 2022(06): 106-108+113 . 百度学术
7.	廖彬彬，张广兴，刁祖龙，谢高岗. 基于深度强化学习的MPTCP动态编码调度系统. 高技术通讯. 2022(07): 727-736 . 百度学术
8.	刘伟，张涛. 移动边缘计算中基于视频内容协作分发的联合激励机制. 计算机应用研究. 2021(09): 2803-2810 . 百度学术
9.	肖巍，卢劲伉，李博深，吴启槊，白英东，潘超. Faster RCNN优化实时人数流量检测. 长春工业大学学报. 2020(04): 369-374 . 百度学术