高级检索

    一种云平台中的异常检测轻量化模型智能构建方案

    An Intelligent Lightweight Model Construction Solution for Anomaly Detection in Cloud Platforms

    • 摘要: 通过全面监控和分析云平台中的各类访问与操作,及时准确地发现潜在的异常行为,对保障云服务的安全高效运行具有重要意义. 云平台中存在大量异常检测任务,现有方法通常需要针对性地对各个任务进行专门设计和调优,不具备对相关异常检测任务通用的模型构建能力. 同时,这一过程高度依赖机器学习相关专业知识,使得领域专家难以构建出适用于实际任务的有效模型. 针对上述问题,提出了一种云平台中的异常检测轻量化模型智能构建方案. 该方案相较于现有技术,1)支持不同类型的云平台异常检测任务,领域专家仅需提供任务相关基本配置信息,即可基于该方案快速自助地搭建面向目标任务的异常检测模型;2)能使专家在具备尽可能少的机器学习和深度学习知识情况下,通过特征自动构造、特征自动优化和模型超参数自动优化等实现目标异常任务的轻量化模型智能构建. 基于大规模真实云场景所收集数据的案例分析和实验结果表明,所提出方案能针对相关异常检测任务快速自助地搭建模型并具备良好的检测能力.

       

      Abstract: In order to ensure the safety and efficient operation of cloud services, it is necessary to conduct comprehensive monitoring and analysis of various accessing behaviors and operations in cloud platforms, aiming at detecting potential abnormal behaviors in a timely and accurate manner. There are numerous anomaly detection tasks in cloud platforms. Existing approaches usually require task-specific customized design and fine-tuning, lacking generalizable model construction capabilities for various anomaly detection tasks. Moreover, this process heavily relies on machine learning expertise, making it challenging for domain experts to develop effective models suitable for practical applications. To address the above problems, an intelligent lightweight model construction solution is proposed for anomaly detection in cloud platforms. Compared with existing technology, the proposed solution 1) supports diverse types of anomaly detection tasks in cloud platforms, allowing domain experts to achieve a timely and self-service construction of task-oriented anomaly detection models by simply providing basic task-specific configuration information; 2) enables domain experts to intelligently construct lightweight models for target anomaly detection tasks through automated feature construction, feature optimization, and hyperparameter tuning, even with minimal machine learning and deep learning expertise. Both the case studies and the experimental results based on data collected from large-scale real-world cloud scenarios demonstrate the proposed solution could build models for relevant anomaly detection tasks in a timely and self-service manner, while strong detection capabilities are also achieved in the constructed models.

       

    /

    返回文章
    返回