Closed High Utility Itemsets Mining over Data Stream Based on Sliding Window Model
-
摘要: 从数据流中挖掘高效用项集是一项具有挑战性的任务，因为传入的数据必须在时间和存储内存约束下进行实时处理.数据流挖掘通常会产生大量冗余的项集，为了减少这些无用的项集数量且保证无损压缩，需要挖掘闭合项集，它可以比全集高效用项集的集合小几个数量级.为了解决以上问题，提出一种基于滑动窗口模型的数据流闭合高效用项集挖掘(closed high utility itemsets mining over data stream based on sliding window model, CHUI_DS)算法. 在CHUI_DS中设计了一种新的效用列表结构，该结构在提升批次插入和删除的速度方面非常有效.此外，应用修剪策略来改进闭合项集挖掘过程，消除潜在的低效用候选对象.对真实数据集和合成数据集进行的广泛实验评估显示了该算法的效率以及可行性.就速度而言，它优于先前提出的主要以批处理模式运行的算法. 且它适用于不同大小的滑动窗口，在事务数量等方面具有较强的扩展性.Abstract: It is a challenging task to mine high utility itemsets from the data stream, because the incoming data stream must be processed in real time within the constraints of time and storage memory. Data stream mining usually generates a large number of redundant itemsets. In order to reduce the number of these useless itemsets and ensure lossless compression of complete high utility itemsets, it is necessary to mine closed itemsets, which can be several orders of magnitude smaller than the collection of complete high utility itemsets. In order to solve the above problem, a high utility itemsets mining algorithm (sliding-window-model-based closed high utility itemsets mining on data stream, CHUI_DS) is proposed to achieve mining closed high utility itemsets on data stream. A new utility-list structure is designed in CHUI_DS, which is very effective in increasing the speed of batch insertion and deletion. In addition, effective pruning strategies are applied to improve the closed itemset mining process and eliminate potential low-utility candidates. Extensive experimental evaluation of the proposed algorithm on real datasets and synthetic datasets shows the efficiency and feasibility of the algorithm. In terms of speed, it is superior to the previously proposed algorithms that mainly run in batch mode. Moreover, it is suitable for sliding windows of different sizes, and has strong scalability in terms of the number of transactions.
-
Keywords:
- pattern mining /
- data stream mining /
- closed high utility itemsets /
- sliding window /
- utility list
-
-
期刊类型引用(12)
1. 李晓静，杨秀杰. 云计算环境下多模态异构网络数据安全存储方法. 现代电子技术. 2025(06): 63-67 . 
百度学术
2. 李林，左天才，杜泽新，谢志奇. 基于LSM树的在线监测数据安全存储系统设计. 电子设计工程. 2024(07): 63-67 . 百度学术
3. 闫丽飞，褚宇宁，赵维伟，何壮壮，刘晓强. 大规模非结构化数据资源快速存储方法研究. 集成电路与嵌入式系统. 2024(04): 77-81 . 百度学术
4. 何博宇，潘洪志. 大数据环境下位置轨迹安全存储系统研究与实现. 电脑知识与技术. 2024(10): 77-80 . 百度学术
5. 巢成，蒲非凡，许建秋，高云君. 基于空间位置关系的轨迹数据高效降维和查询算法. 计算机研究与发展. 2024(07): 1771-1790 . 本站查看
6. 王芳，王建民，邵芬红. 多信道无线通信网络动态数据完整性存储仿真. 计算机仿真. 2024(07): 451-455 . 百度学术
7. 张铠，黄晋，汪希. 基于区块链技术的网络信息安全访问控制方法. 信息技术与信息化. 2024(09): 197-200 . 百度学术
8. 马明扬，杨洪勇，刘飞. 基于强化学习的双人博弈差分隐私保护研究. 复杂系统与复杂性科学. 2024(04): 107-114 . 百度学术
9. 李玉光，郗海龙. 物联网异构数据库分层访问算法仿真. 计算机仿真. 2023(03): 490-493+498 . 百度学术
10. 吕舰. 基于国密算法的网络通信传输数据安全存储方法. 长江信息通信. 2023(04): 171-174 . 百度学术
11. 王辉，陈宇，申自浩，刘沛骞. 结合对比监督和排序树的轨迹数据差分隐私保护方案. 计算机工程与科学. 2023(10): 1797-1805 . 百度学术
12. 王爱兵. 基于区块链的社区矫正系统数据分布式安全存储方法. 电脑知识与技术. 2023(28): 63-65 . 百度学术
其他类型引用(12)
计量
- 文章访问数:
- HTML全文浏览量: 0
- PDF下载量:
- 被引次数: 24
下载:
