基于时序窗口的概念漂移类别检测

郭虎升; 任巧燕; 王文剑

doi:10.7544/issn1000-1239.20200562

基于时序窗口的概念漂移类别检测

¹(山西大学计算机与信息技术学院太原 030006)
²(计算智能与中文信息处理教育部重点实验室(山西大学) 太原 030006) (guohusheng@sxu.edu.cn)

基金项目: 国家自然科学基金项目(61503229,U1805263,62076154)；山西省自然科学基金项目(201901D111033)；山西省重点研发计划项目(国际合作)(201903D421050) 62076154), the Natural Science Foundation of Shanxi Province (201901D111033), and the Key Research and Development Program of Shanxi Province (International Cooperation) (201903D421050).

详细信息

中图分类号: TP181
计量
- 文章访问数: 334
- HTML全文浏览量: 9
- PDF下载量: 271
出版历程
- 发布日期: 2021-12-31

Concept Drift Class Detection Based on Time Window

¹(School of Computer and Information Technology, Shanxi University, Taiyuan 030006)
²(Key Laboratory of Computational Intelligence and Chinese Information Processing(Shanxi University), Ministry of Education, Taiyuan 030006)

Funds: This work was supported by the National Natural Science Foundation of China (61503229, U1805263,

摘要

摘要: 流数据作为一种新型数据，在各个领域均有应用，其快速、大量及持续不断的特点使得单遍精准扫描成为在线学习算法的必备特质.在流数据不断产生过程中，往往会发生概念漂移，目前对于概念漂移节点检测的研究相对成熟，然而实际问题中学习环境因素朝不同方向发展往往会导致流数据中概念漂移类别的多样性，这给流数据挖掘及在线学习带来了新的挑战.针对这个问题，提出一种基于时序窗口的概念漂移类别检测(concept drift class detection based on time window, CD-TW)方法.该方法借助栈和队列对流数据进行存取，借助窗口机制对流数据进行分块学习.首先创建2个分别加载历史数据和当前数据的基础节点时序窗口，通过比较二者所包含数据的分布变化情况来检测概念漂移节点.然后创建加载漂移节点后部分数据的跨度时序窗口，通过分析该窗口中数据分布的稳定性检测漂移跨度，进而判断概念漂移类别.实验结果表明该方法不仅能够精确定位概念漂移节点，同时在漂移类别判断方面也表现出良好性能.
- 流数据 /
- 概念漂移 /
- 时序窗口 /
- 漂移跨度 /
- 概念漂移类别
Abstract: As a new type of data, streaming data has been applied in various application fields. Its fast, massive and continuous characteristics make single pass and accurate scanning become essential features of online learning. In the process of continuous generation of streaming data, concept drift often occurs. At present, the research on concept drift detection is relatively mature. However, in reality, the development of learning environment factors in different directions often leads to the diversity of concept drift class in streaming data, which brings new challenges to streaming data mining and online learning. To solve this problem, this paper proposes a concept drift class detection method based on time window (CD-TW). In this method, stack and queue are used to access the data, and window mechanism is used to learn streaming data in chunks. This method detects concept drift site by creating two basic site time windows which load historical data and current data respectively and comparing the distribution changes of the data contained in them. Then, a span time window loading partial data after drift site is created. The drift span is obtained by analyzing the distribution stability of the data in span time window, which is further used to judge the concept drift class. The results of experiment demonstrate that CD-TW can not only detect concept drift site accurately, but also show good performance in judging the class of concept drift.
- streaming data /
- concept drift /
- time window /
- drift span /
- concept drift class