高级检索

    稀疏计算的领域专用加速器综述

    A Survey of Domain-Specific Accelerators for Sparse Computation

    • 摘要: 稀疏基础线性代数子程序是人工智能与大规模科学计算中的重要基元,其非零元分布的不规则性与动态性,使传统硬件体系结构面临访存带宽利用受限、计算资源利用率低与系统级通信开销高等问题。为分析上述瓶颈及现有优化方法,本文基于扩展Roofline模型梳理了领域专用稀疏加速器的体系结构演进,并将相关优化策略归纳为数据通路、计算核心与阵列协同3个层级。归纳结果表明,稀疏数据表示与压缩、局部性复用与片上存储优化可减少无效数据搬运,稀疏感知执行与冗余削减可提高计算资源利用率,空间互连、动态调度与通信归约可缓解负载不均衡与网络拥塞。现有研究虽在特定场景下取得了显著性能收益,但跨层协同仍显不足。稀疏计算体系结构的未来发展方向包括软硬件协同编译、运行时自适应调度与异构多芯粒集成等。

       

      Abstract: Sparse Basic Linear Algebra Subprograms (SpBLAS) are fundamental kernels in artificial intelligence and large-scale scientific computing. Their irregular and dynamic nonzero distributions limit memory bandwidth utilization, compute resource utilization, and system-level communication efficiency. To analyze these bottlenecks, the architectural evolution of domain-specific sparse accelerators is reviewed using an extended Roofline model, and related optimizations are categorized into datapath, compute-core, and array-level coordination. Datapath techniques reduce ineffective data movement through sparse representation, compression, locality-aware reuse, and on-chip memory management. Compute-core techniques improve utilization through sparse-aware execution, redundant-operation reduction, and precision optimization. Array-level techniques alleviate load imbalance and network congestion through spatial interconnects, dynamic scheduling, and communication reduction. Existing studies achieve substantial gains in specific scenarios, but cross-layer coordination remains insufficient because of trade-offs between data supply and computation, bandwidth efficiency and on-chip resource overhead, and operator specialization and system-level generality. Future architectures should explore software-hardware co-compilation, runtime adaptive scheduling, and heterogeneous multi-chiplet integration to improve overall efficiency and generality.

       

    /

    返回文章
    返回