基于强化学习DQN的智能体信任增强

亓法欣; 童向荣; 于雷

doi:10.7544/issn1000-1239.2020.20190403

基于强化学习DQN的智能体信任增强

¹(烟台大学计算机与控制工程学院山东烟台 264005)
²(纽约州立大学宾汉姆顿分校计算机科学系纽约州宾汉姆顿市 13902) (qifaxin123@163.com)

基金项目: 国家自然科学基金项目(61572418)

详细信息

中图分类号: TP18
计量
- 文章访问数: 1171
- HTML全文浏览量: 11
- PDF下载量: 405
出版历程
- 发布日期: 2020-05-31

Agent Trust Boost via Reinforcement Learning DQN

¹(School of Computer and Control Engineering, Yantai University, Yantai, Shandong 264005)
²(Department of Computer Science, State University of New York at Binghamton, Binghamton, NY 13902)

Funds: This work was supported by the National Natural Science Foundation of China (61572418).

摘要

摘要: 信任推荐系统是以社交网络为基础的一种重要推荐系统应用，其结合用户之间的信任关系对用户进行项目推荐.但之前的研究一般假定用户之间的信任值固定，无法对用户信任及偏好的动态变化做出及时响应，进而影响推荐效果.实际上，用户接受推荐后，当实际评价高于心理预期时，体验用户对推荐者的信任将增加，反之则下降.针对此问题，并且重点考虑用户间信任变化过程及信任的动态性，提出了一种结合强化学习的用户信任增强方法.因此，使用最小均方误差算法研究评价差值对用户信任的动态影响，利用强化学习方法deep q-learning(DQN)模拟推荐者在推荐过程中学习用户偏好进而提升信任值的过程，并且提出了一个多项式级别的算法来计算信任值和推荐，可激励推荐者学习用户的偏好，并使用户对推荐者的信任始终保持在较高程度.实验表明，方法可快速响应用户偏好的动态变化，当其应用于推荐系统时，相较于其他方法，可为用户提供更及时、更准确的推荐结果.
- 多智能体系统 /
- 强化学习 /
- 信任 /
- 深度q学习 /
- 最小均方误差方法
Abstract: Trust recommendation system is an important application of recommendation system based on social network. It combines the trust relationship between users to recommend items to users. However, previous studies generally assume that the trust value between users is fixed, so it is unable to respond to the dynamic changes of user trust and preferences in a timely manner, thus affecting the recommendation effect. In fact, after receiving the recommendation, there is a difference between actual evaluation and expected evaluation which is correlated with trust value. The user’s trust in the recommender will increase when the actual evaluation is higher than expected evaluation, and vice versa. Based on the dynamics of trust and the changing process of trust between users, this paper proposes a trust boost method through reinforcement learning. Least mean square algorithm is used to learn the dynamic impact of evaluation difference on user’s trust. In addition, a reinforcement learning method deep q-learning (DQN) is studied to simulate the process of learning user’s preferences and boosting trust value. Finally, a polynomial level algorithm is proposed to calculate the trust value and recommendation, which can motivate the recommender to learn the user’s preference and keep the user’s trust in the recommender at a high level. Experiments indicate that our method applied to recommendation systems could respond to the changes quickly on user’s preferences. Compared with other methods, our method has better accuracy on recommendation.
- multi-agent systems /
- reinforcement learning /
- trust /
- deep q-learning (DQN) /
- least mean square (LMS)

HTML全文

参考文献(0)

施引文献(11)

期刊类型引用(7)

1.	李曼文，张月琴，张晨威，张泽华. 异质图嵌入的地理不敏感时空兴趣点推荐方法. 计算机科学与探索. 2024(03): 755-767 . 百度学术
2.	金柯君，于洪涛，吴翼腾，李邵梅，张建朋，郑洪浩. 改进的基于奇异值分解的图卷积网络防御方法. 计算机应用. 2023(05): 1511-1517 . 百度学术
3.	王小红，刘琴. 基于深度迁移的有向加权网络节点重叠检测. 计算机仿真. 2023(09): 492-496 . 百度学术
4.	金柯君，于洪涛，李邵梅，张建朋. 基于注意力机制的图卷积网络防御方法. 信息工程大学学报. 2023(06): 718-724 . 百度学术
5.	杨旭华，王磊，叶蕾，张端，周艳波，龙海霞. 基于节点相似性和网络嵌入的复杂网络社区发现算法. 计算机科学. 2022(03): 121-128 . 百度学术
6.	刘志鑫，张泽华，张杰. 基于多层次多视角的图注意力Top-N推荐方法. 计算机科学. 2021(04): 104-110 . 百度学术
7.	陈晋音，黄国瀚，张敦杰，张旭鸿，纪守领. 一种面向图神经网络的图重构防御方法. 计算机研究与发展. 2021(05): 1075-1091 . 本站查看