结合分层深度网络与双向五元组损失的跨模态异常检测

范烨; 彭淑娟; 柳欣; 崔振; 王楠楠

doi:10.7544/issn1000-1239.20210729

结合分层深度网络与双向五元组损失的跨模态异常检测

范烨^1,2,
彭淑娟^1,2,
柳欣^1,2,
崔振³,
王楠楠⁴

¹(华侨大学计算机科学与技术学院福建厦门 361021)
²(厦门市计算机视觉与模式识别重点实验室(华侨大学) 福建厦门 361021)
³(南京理工大学计算机科学与工程学院南京 210094)
⁴(综合业务网理论及关键技术国家重点实验室(西安电子科技大学) 西安 710071) (fanye@stu.hqu.edu.cn)

基金项目: 之江实验室开放课题(2021KH0AB01)；国家自然科学基金项目(61673185,61922066,62072244)；福建省自然科学基金项目(2020J01083,2020J01084)；高维信息智能感知与系统教育部重点实验室开放课题(JYB202102)

详细信息

中图分类号: TP391
计量
- 文章访问数: 182
- HTML全文浏览量: 1
- PDF下载量: 93
出版历程
- 发布日期: 2022-11-30

Cross-Modal Anomaly Detection via Hierarchical Deep Networks and Bi-Quintuple Loss

¹(College of Computer Science and Technology, Huaqiao University, Xiamen, Fujian 361021)
²(Xiamen Key Laboratory of Computer Vision and Pattern Recognition (Huaqiao University), Xiamen, Fujian 361021)
³(School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094)
⁴(State Key Laboratory of Integrated Services Networks (Xidian University), Xi’an 710071)

Funds: This work was supported by the Open Research Projects of Zhejiang Lab (2021KH0AB01), the National Natural Science Foundation of China (61673185, 61922066, 62072244), the Natural Science Foundation of Fujian Province (2020J01083, 2020J01084), and the Open Research Projects of Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education (JYB202102).

摘要

摘要: 大数据环境下的跨模态异常检测是一个非常有价值且极具挑战性的工作.针对目前已有跨模态异常检测框架对数据异常值类型检测不全面以及数据利用率较低的问题，提出了一个结合分层深度网络与相似度双向五元组损失的跨模态异常检测方法.首先，提出的框架引入一个单视图异常检测网络层，通过模态内近邻样本相似度来检测数据样本中是否存在属性异常与部分属性-类别异常点；接着，提出基于相似度双向五元组损失的双分支深度网络用于检测数据中的类别异常与剩余部分的属性-类别异常，该损失一方面能够使不同属性数据正交化，另一方面使得相同属性数据之间线性相关，从而有效地加大了不同属性数据之间的特征差异性，以及增加了相同属性之间的特征相关性；同时，提出的双分支网络通过模态间双向约束和模态内的邻域约束，极大提高了数据利用率和模型的泛化能力.实验结果表明，所提出的框架可以全面检测出不同模态中所有的异常类型样本点，并且表现优于现有的可应用于跨模态异常检测的方法，优势明显.
- 跨模态异常检测 /
- 分层深度网络 /
- 双向五元组损失 /
- 邻域约束 /
- 双向约束
Abstract: Cross-modal anomaly detection in big data environment is a very valuable and challenging work. Existing cross-modal anomaly detection framework often suffers from the incomplete data anomaly detection and low data utilization problems. To alleviate these concerns, an efficient cross-modal anomaly detection framework is proposed via hierarchical deep networks and similarity based bi-quintuple loss. First, the proposed framework introduces a single-view anomaly detection network to detect the attribute anomaly and part of class-attribute anomaly in data samples. Then, the similarity bi-quintuple loss, integrated with double-branch deep networks, is efficiently developed to detect the class anomaly and the remaining part class-attribute anomaly in data samples. Meanwhile, this loss regularizes the different attribute data with orthogonal property, and ensures the linear correlation between the same attribute data, enlarges the feature difference between different attribute data and increases the feature correlation between the same attribute data. Meanwhile, the bidirectional constraint and neighborhood constraint can significantly improve the data utilization and the generalization ability of the model. Extensive experimental results show that the proposed framework is able to detect possible abnormal sample points in different modalities, and outperforms the state-of-the-art corresponding methods, with obvious advantages.
- cross-modal anomaly detection /
- hierarchical deep network /
- bi-quintuple loss /
- neighborhood constraint /
- bidirectional constraint