高级检索

    基于注意力机制的动态特征剪枝与自适应部署优化

    Dynamic Feature Pruning and Adaptive Deployment Optimization Based on Attention Mechanism

    • 摘要: 随着深度神经网络(deep neural network,DNN)模型规模与计算复杂度不断增加,其对计算、存储和能耗的高要求限制了在资源受限边缘设备上的高效部署。针对模型压缩过程中准确率保持困难以及异构设备适配性不足的问题,提出一种基于注意力机制的动态特征剪枝与自适应部署方法。通过构建通道—空间注意力模块,对特征重要性进行动态评估并剪除冗余特征,在降低计算开销的同时保持关键特征表达;进一步设计自适应部署框架(adaptive deployment framework,ADF),通过单次训练生成多种压缩配置的子模型,以适配不同资源约束下的边缘设备。CIFAR-10数据集实验结果表明,该方法可降低约48%的浮点运算量FLOPs(floating-point operations),准确率仅下降0.2%。结果表明,该方法能够在较小准确率损失下有效降低模型复杂度,并提升DNN在边缘环境中的部署效率与灵活性。

       

      Abstract: The increasing size and computational complexity of deep neural networks (DNNs) impose substantial demands on computing resources, storage capacity, and energy consumption, which restrict their efficient deployment on resource-constrained edge devices. To address the challenges of maintaining inference accuracy during model compression and adapting models to heterogeneous hardware resources, an attention-based dynamic feature pruning and adaptive deployment method is proposed. A channel-spatial attention module is first constructed to dynamically evaluate feature importance from both channel and spatial dimensions, enabling redundant features to be selectively pruned while preserving informative representations and reducing computational overhead. Furthermore, an adaptive deployment framework (ADF) is designed to generate multiple submodels with different compression configurations through a single training process. According to the available computing and storage resources of target edge devices, an appropriate submodel can be selected for deployment, thereby improving hardware adaptability. Experimental results on the CIFAR-10 dataset show that the proposed method reduces floating-point operations (FLOPs) by approximately 48% while causing only a 0.2% decrease in accuracy. These results demonstrate that combining attention-guided dynamic feature pruning with adaptive deployment can effectively reduce model computational complexity while maintaining performance, and can improve the deployment efficiency and flexibility of DNNs in heterogeneous edge computing environments.

       

    /

    返回文章
    返回