数据驱动并行计算的3层软件架构设计及应用

张爱清; 莫则尧; 杨章

doi:10.7544/issn1000-1239.2014.20131241

数据驱动并行计算的3层软件架构设计及应用

(北京应用物理与计算数学研究所北京 100094) (计算物理重点实验室北京 100094) (zhang_aiqing@iapcm.ac.cn)

基金项目: 国家自然科学基金重点项目(61033009)；国家“九七三”重点基础研究发展计划基金项目(2011CB309702)；国家“八六三”高技术研究发展计划基金项目(2012AA01A309)

详细信息

中图分类号: TP311
计量
- 文章访问数: 01523
- HTML全文浏览量: 0
- PDF下载量: 01327
出版历程
- 发布日期: 2014-10-31

Three-Level Hierarchical Software Architecture for Data-Driven Parallel Computing with Applications

(Institute of Applied Physics and Computational Mathematics, Beijing 100094) (National Key Laboratory of Science and Technology on Computational Physics, Beijing 100094)

摘要

摘要: 数据驱动并行计算是科学与工程计算中普遍存在的一类计算，其执行通常依赖于数据流有向图.在实际应用中，结点调度、数据通信和数值计算紧耦合并发执行，较难解耦编程，这给应用软件的协同研制和代码复用带来困难.借助于统一形式的数据流有向图并行算法框架，分无环有向图调度、无环有向图建模和数值计算3个层次，设计了软件体系结构，实现于并行自适应结构网格应用支撑软件(J parallel adaptive structured mesh applications infrastructure, JASMIN)框架的通量扫描积分构件中，有力地支持了结点调度、数据通信和数值计算的解耦编程.研究成果成功应用于科学计算中典型的中子输运计算，典型的代码开销测试和2 048个处理器核的并行性能测试表明，软件架构及其构件化实现是有效的.
- 数据驱动 /
- 并行计算 /
- 无环有向图 /
- JASMIN框架 /
- 软件体系结构 /
- 解耦
Abstract: Data-driven parallel computing is widely used in scientific and engineering computation. Most of these computations are based on data dependency diagraphs. In real word applications, vertex scheduling, data communication and numerical computation are executed concurrently in a tightly coupled way, and it is hard to implement in a decoupled manner, which imposes difficulties for both application software co-design and code reuse. To address these problems, in this paper, we propose a hierarchical software architecture and implement it in sweeping integrator component, which is the part of the J adaptive structured mesh infrastructure (JASMIN). The hierarchical architecture is based on a unified algorithm framework for data dependency diagraph computation. It consists of three levels, including directed acyclic graph (DAG) scheduling level, DAG modeling level and numerical computation level. This design provides strong support for decoupled implementation of vertex scheduling, data communication and numerical computation, which are essential in data-driven parallel computing. We apply this result in typical scientific computing applications such as neutron transportation. The sequential implementation overhead and parallel performance results are obtained on a parallel computer with 2048 CPU cores. These results suggest that our hierarchical software architecture and component-based implementation are both effective and efficient.
- data driven /
- parallel computing /
- directed acyclic graph /
- J adaptive structured mesh infrastructure (JASMIN) /
- software architecture /
- decoupling

HTML全文

参考文献(0)

施引文献(25)

期刊类型引用(9)

1.	张恩，王梦涛，郑东，禹勇，黄昱晨. 低带宽场景下防合谋多方隐私集合并集协议. 通信学报. 2025(01): 210-221 . 百度学术
2.	李子贤，刘文杰. 求解最小公倍数问题的量子安全多方计算协议. 计算机学报. 2024(06): 1393-1412 . 百度学术
3.	逯绍锋，胡玉龙，逯跃锋. 保护隐私的集合相似性度量协同计算协议. 计算机技术与发展. 2023(01): 137-143 . 百度学术
4.	魏立斐，王勤，张蕾，陈聪聪，陈玉娇，宁建廷. 半可信云服务器辅助的高效隐私交集计算协议. 软件学报. 2023(02): 932-944 . 百度学术
5.	家珠亮，赵雪玲，李顺东. 分布式多重集众数及重数的保密计算. 密码学报. 2023(01): 102-117 . 百度学术
6.	魏立斐，刘纪海，张蕾，宁建廷. 双云辅助的超阈值多方隐私集合交集计算协议. 软件学报. 2023(11): 5442-5456 . 百度学术
7.	赵宗渠，王书静，汤永利，霍亚超，杨丽. 基于理想格的两方隐私集合交集协议. 计算机应用研究. 2023(12): 3795-3799 . 百度学术
8.	徐琳，魏晓超，蔡国鹏，王皓，郑志华. 一个高效的安全两方近似模式匹配协议. 计算机研究与发展. 2022(08): 1819-1830 . 本站查看
9.	魏立斐，刘纪海，张蕾，王勤，贺崇德. 面向隐私保护的集合交集计算综述. 计算机研究与发展. 2022(08): 1782-1799 . 本站查看