Parallel Algorithm of Fast Independent Component Analysis for Dimensionality Reduction on Many Integrated Core
-
摘要: 高光谱遥感影像快速独立成分分析(fast independent component analysis, FastICA)降维过程包含大规模矩阵计算及大量迭代计算.通过热点分析,面向集成众核(many integrated core, MIC)架构设计了协方差矩阵计算、白化处理和ICA迭代等热点并行方案,提出和实现一种M-FastICA并行降维算法,并构建算法性能模型;基于集成众核研究并行程序优化策略,针对各热点并行方案提出一系列优化策略,特别是创新性地提出一种下三角阵负载均衡方法,并量化测试其优化效果.实验结果显示M-FastICA算法最高可加速42倍,比24核CPU多线程并行快2.2倍;探讨了波段数与并行程序性能的关系;实验数据验证了算法性能模型的准确性.Abstract: There are massive matrix and iterative calculations in fast independent component analysis (FastICA) for hyperspectral image dimensionality reduction. By analyzing hotspots of FastICA algorithm, we design the parallel schemes of covariance matrix calculating, whitening processing and ICA iteration on many integrated core (MIC), implement and validate an M-FastICA algorithm. Further, we present a performance model for M-FastICA. We present a series of optimization methods for the parallel schemes of different hotspots: reforming the arithmetic operations, interchanging and unrolling loops, transposing matrix, using intrinsics and so on. In particular, we propose a novel method to balance the loads when dealing with the lower triangular matrix. Then we measure the performance effects of such optimization methods. Our experiments show that the M-FastICA algorithm can reach a maximum speed-up of 42X times in our test, and it runs 2.2X times faster than the CPU parallel version on 24 cores. We also investigate how the speed-ups change with the bands. The experiment results validate our performance model with an acceptable accuracy and thus can provide a roofline for our optimization effort.
-
-
期刊类型引用(10)
1. 徐怡,陶强. 划分序乘积空间约简算法研究. 系统工程理论与实践. 2025(02): 554-570 . 百度学术
2. 刘长顺,刘炎,宋晶晶,徐泰华. 基于论域离散度的属性约简算法. 山东大学学报(理学版). 2023(05): 26-35+52 . 百度学术
3. 张清华,艾志华,张金镇. 融合密度与邻域覆盖约简的分类方法. 陕西师范大学学报(自然科学版). 2022(03): 33-42 . 百度学术
4. 张雨新,孙达明,李飞. 基于粒化单调的不完备混合型数据增量式属性约简算法. 计算机应用与软件. 2021(03): 279-286 . 百度学术
5. 邹丽,任思远,杨光,杨鑫华. 基于改进条件邻域熵的接头疲劳寿命影响因素分析. 焊接学报. 2021(11): 43-50+99-100 . 百度学术
6. 刘正,陈雪勤,张书锋. 基于最小化邻域互信息的邻域熵属性约简算法. 微电子学与计算机. 2020(03): 26-32 . 百度学术
7. 陈帅,张贤勇,唐玲玉,姚岳松. 邻域互补信息度量及其启发式属性约简. 数据采集与处理. 2020(04): 630-641 . 百度学术
8. 周艳红,张强. 基于三层粒结构的三支邻域熵. 数学的实践与认识. 2020(14): 83-93 . 百度学术
9. 亓慧,史颖. 不同度量下集成属性选择器的对比研究. 山西大学学报(自然科学版). 2019(04): 848-853 . 百度学术
10. 周艳红,张迪,张强. 基于单调信息度量的特定类属性约简. 内江师范学院学报. 2019(12): 35-39 . 百度学术
其他类型引用(11)
计量
- 文章访问数: 1168
- HTML全文浏览量: 0
- PDF下载量: 461
- 被引次数: 21