Video Anomaly Detection Based on Space-Time Fusion Graph Network Learning
-
摘要: 视频中异常事件所体现的时空特征存在着较强的相关关系.针对视频异常事件发生的时空特征相关性而影响检测性能问题,提出了基于时空融合图网络学习的视频异常事件检测方法,该方法针对视频片段的特征分别构建空间相似图和时间连续图,将各片段对应为图中的节点,考虑各节点特征与其他节点特征的Top-k相似性动态形成边的权重,构成空间相似图；考虑各节点的m个时间段内的连续性形成边的权重,构成时间连续图．将空间相似图和时间连续图进行自适应加权融合形成时空融合图卷积网络,并学习生成视频特征.在排序损失中加入图的稀疏项约束降低图模型的过平滑效应并提升检测性能.在UCF-Crime和ShanghaiTech等视频异常事件数据集上进行了实验,以接收者操作曲线(receiver operating characteristic curve, ROC)以及曲线下面积(area under curve, AUC)值作为性能度量指标.在UCF-Crime数据集下,提出的方法在AUC上达到80.76%,比基准线高5.35%；在ShanghaiTech数据集中,AUC达到89.88%,比同类最好的方法高5.44%.实验结果表明:所提出的方法可有效提高视频异常事件检测的性能.Abstract: There are strong correlations among spatial-temporal features of abnormal events in videos. Aiming at the problem of performance for abnormal event detection caused by these correlations, a video anomaly detection method based on space-time fusion graph network learning is proposed. In this method, spatial similarity graph and temporal trend graph for the segments are constructed in terms of the features of the segments. The spatial similarity graph is built dynamically by treating the features of the video segments as the vertexes in graph. In this graph, the weights of edges are dynamically formed by taking the relationship between vertex and its Top-k similarity vertexes into account. The temporal trend graph is built by taking the time distance for m sequential segments into account. The space-time fusion graph convolutional network is constructed by adaptively weighting the spatial similarity graph and temporal trend graph. The video embedding features are learnt and generated by using this graph convolutional network. A graph sparse regularization is added to the ranking loss, in order to reduce the over-smoothing effect of graph model and improve detection performance. The experiments are conducted on two challenging video datasets: UCF-Crime(University of Central Florida crime dataset) and ShanghaiTech. ROC(receiver operating characteristic curve) and AUC (area under curve) are taken as performance metrics. Our method obtains the AUC score of 80.76% rising by 5.35% compared with the baseline on UCF-Crime dataset, and also gets the score of 89.88% rising by 5.44% compared with SOTA(state of the art) weakly supervised algorithm on ShanghaiTech. The experimental results show that our proposed method can improve the performance of video abnormal event detection effectively.
-
-
期刊类型引用(15)
1. 吴宪，汤红波，赵宇，许明艳. 一种有状态容器跨集群实时迁移方法. 计算机研究与发展. 2024(02): 494-502 . 
本站查看
2. 张人杰，李頔，王方，刘慧. NFV场景下基于协议和目的端口的负载均衡策略. 湖南邮电职业技术学院学报. 2024(03): 1-7 . 百度学术
3. 梁婷婷，张向利. 基于优先级的网络切片映射算法. 桂林电子科技大学学报. 2024(06): 606-612 . 百度学术
4. 王雅倩，陈心怡，曲睿，周振宇. 基于SDN/NFV的电力物联网时延敏感业务编排方法. 华北电力大学学报(自然科学版). 2023(01): 84-91 . 百度学术
5. 苏警. 面向大数据的可扩展网络服务框架设计. 兰州文理学院学报(自然科学版). 2023(01): 50-55 . 百度学术
6. 陈婷婷，肖源源. 浅析“新工科”背景下大数据综合实验平台的建设. 中国新通信. 2023(01): 42-47 . 百度学术
7. 刘光远，曹晶仪，庞紫园，黄书翠. 一种低时延虚拟网络功能映射及调度优化算法. 西安交通大学学报. 2023(02): 121-130 . 百度学术
8. 王媛滔，舒兆港，钟一文，邱彩钰，田佳霖. 基于VNF实例共享的服务功能链部署算法. 计算机应用研究. 2023(06): 1806-1811 . 百度学术
9. 熊泽凯，王素红，王靖君，祝长鸿，覃团发. 移动边缘计算中服务功能链的自适应优化部署策略. 电讯技术. 2023(11): 1678-1686 . 百度学术
10. 张庆华，张先超，王寅昊，陆军. 面向医疗急救的信息网络服务功能链调度方法. 电子学报. 2023(11): 3128-3136 . 百度学术
11. 陈炳丰，谢光强，朱鉴. 基于FusionCompute的虚拟化技术在计算机实验室中的应用. 实验技术与管理. 2022(04): 224-227 . 百度学术
12. 任诚，陈绪祥，唐斌文，王宇，李豪. 多源多播服务功能链优化部署算法. 计算机应用研究. 2022(06): 1814-1819 . 百度学术
13. 朱国晖，景文焕，李世昌. 基于改进麻雀搜索算法的服务功能链优化映射算法. 计算机应用研究. 2022(07): 2120-2123+2131 . 百度学术
14. 陈嘉亮，王丰，张潇. 移动边缘计算网络下的服务功能链部署优化设计. 计算机应用研究. 2022(10): 3108-3113 . 百度学术
15. 陈杨，刘作，黎聪，龙俊霖，赵群帅. 基于SDN与NFV的云通信软交换能力切片化部署稳定性研究. 通信技术. 2021(09): 2163-2168 . 百度学术
其他类型引用(38)
计量
- 文章访问数: 1172
- HTML全文浏览量: 3
- PDF下载量: 794
- 被引次数: 53
下载:
