面向国产异构DCU平台的大规模并行矩量法研究

doi:10.19665/j.issn1001-2400.20230504

Abstract

Abstract:

In view of the current development trend of the domestic supercomputer CPU+DCU heterogeneous architecture,the research on the CPU+DCU massively heterogeneous parallel higher-order method of moments is carried out.First,the basic implementation strategy of DCU to accelerate the calculation of the method of moments is given.Based on the load balancing parallel strategy of the isomorphic parallel moment of methods,an efficient heterogeneous parallel programming framework of "MPI+openMP+DCU" is proposed to address the problem of mismatch between computing tasks and computing power.In addition,the fine-grained task division strategy and asynchronous communication technology are adopted to optimize the design of the pipeline for the DCU computation process,thus realizing the overlapping of computation and communication and improving the acceleration performance of the program.The accuracy of the CPU+DCU heterogeneous parallel moment of methods is verified by comparing the simulation results with those by the finite element method.The scalability analytical results based on the domestic DCU heterogeneous platform show that the implemented CPU+DCU heterogeneous co-computing program can obtain 5.5~7.0 times acceleration effect at different parallel scales,and that the parallel efficiency reaches 73.5% when scaled from 360 nodes to 3600 nodes(1,036,800 cores in total).

Key words: method of moments, domestic heterogeneous platforms, deep computing unit(DCU), parallel algorithm

CLC Number:

TN820

JIA Ruipeng, LIN Zhongchao, ZUO Sheng, ZHANG Yu, YANG Meihong. Study of the parallel MoM on a domestic heterogeneous DCU platform[J].Journal of Xidian University, 2024, 51(2): 76-83.

Figures/Tables 11

References 19

[1]	GUO H L, YUE Y Y, BO M Y, et al. Research of Thread Granularity Optimization Strategy for the Domestic DCU Accelerator[C]// 2021 International Conference on Information Science,Parallel and Distributed Systems(ISPDS).Piscataway:IEEE, 2021: 110-115.
[2]	BO M Y, LIU Y Q, YUE Y Y, et al. SpMV Algorithm Based on MPI+HIP Hybrid Model[C]// 2022 7th International Conference on Intelligent Computing and Signal Processing(ICSP). Piscataway:IEEE, 2022: 944-948.
[3]	HE W J, KONG Y N, HE K F, et al. Massively Parallel Approach of Multilevel Fast Multipole Algorithm on DCU Clusters for Large Electromagnetic Scattering Problems[C]// 2021 International Applied Computational Electromagnetics Society(ACES-China) Symposium. Piscataway:IEEE, 2021: 1-2.
[4]	HARRINGTON R F. Field Computation by Moment Methods[M]. New York: Wiley-IEEE Press, 1993.
[5]	翟畅, 林中朝, 赵勋旺, 等. 一种使用八叉树的半空间MLFMA区域分解算法[J]. 西安电子科技大学学报, 2021, 48(6):144-150.
	ZHAI Chang, LIN Zhongchao, ZHAO Xunwang, et al. Algorithm for Half-Space MLFMA Domain Decomposition Utilizing an Octre[J]. Journal of Xidian University, 2021, 48(6):144-150.
[6]	左胜, 陈岩, 张玉, 等. 一种可扩展异构并行核外高阶矩量法[J]. 西安电子科技大学学报, 2017, 44(1):146-151.
	ZUO Sheng, CHEN Yan, ZHANG Yu, et al. Study of the Scalable Heterogeneous Parallel Out-of-Core Higher Order Method of Moments[J]. Journal of Xidian University, 2017, 44(1):146-151.
[7]	CHEN Y, LIN Z C, ZHANG Y, et al. Parallel Out-of-Core Higher-Order Method of Moments Accelerated by Graphics Processing Unit[C]// 2015 IEEE International Symposium on Antennas and Propagation & USNC/URSI National Radio Science Meeting. Piscataway:IEEE, 2015: 1674-1675.
[8]	ZHANG G H, CHEN Y, ZHANG Y, et al. MIC Accelerated LU Decomposition for Method of Moments[C]//Proceedings of 2015 IEEE Antennas and Propagation Society International Symposium. Piscataway:IEEE, 2015:756-757.
[9]	CHEN Y, ZHANG Y, LIN Z C, et al. GPU Accelerated Parallel MoM for Simulating Microstrip Antenna Array[C]//Proceedings of 2014 3rd Asia-Pacific Conference on Antennas and Propagation. Piscataway:IEEE, 2014:1027-1029.
[10]	LIN Z C, CHEN Y, ZHAO X W, et al. Parallel Higher-Order Method of Moments with Efficient Out-of-GPU Memory Schemes for Solving Electromagnetic Problems[J]. Applied Computational Electromagnetics Society Journal, 2017,32:781-788.
[11]	LIN Z C, CHEN Y, ZHANG Y, et al. An Efficient GPU-Based Out-of-Core LU Solver of Parallel Higher-Order Method of Moments for Solving Airborne Array Problems[J]. International Journal of Antennas and Propagation, 2017,2017:1-10.
[12]	CHEN Y, ZUO S, ZHANG Y, et al. Large-Scale Parallel Method of Moments on CPU/MIC Heterogeneous Clusters[J]. IEEE Transactions on Antennas and Propagation, 2017, 65(7):3782-3787.
[13]	ZHANG N N, RONG Z, CHEN Y P, et al. Hierarchical LU Direct Solver Based on Higher Order Basis Function[C]// 2021 International Applied Computational Electromagnetics Society(ACES-China) Symposium. Piscataway:IEEE, 2021: 1-2.
[14]	张玉. 计算电磁学的超大规模并行矩量法[M]. 西安: 西安电子科技大学出版社, 2016.
[15]	奎因. MPI与OpenMP并行程序设计[M]. 北京: 清华大学出版社, 2004.
[16]	ZAMBRE R, CHANDRAMOWLISHWARAN A. Lessons Learned on MPI+Threads Communication[C]//SC22:International Conference for High Performance Computing,Networking,Storage and Analysis. Piscataway:IEEE, 2022:1-16.
[17]	陈岩. 高性能矩量法及其在复杂目标电磁模拟中的应用[D]. 西安: 西安电子科技大学, 2017.
[18]	ZUO S, LIN Z C, LIU J Z, et al. A Fast Parallel Solution Technique for Large Periodic Structures Based on FEM-DDM[J]. IEEE Antennas and Wireless Propagation Letters, 2020, 19(10):1704-1708.
[19]	ZUO S, LIN Z C, GARCÍA-DOÑORO D, et al. A Parallel Direct Domain Decomposition Solver Based on Schur Complement for Electromagnetic Finite Element Analysis[J]. IEEE Antennas and Wireless Propagation Letters, 2021, 20(4):458-462.

节点数	未知量	CPU核	DCU核	计算方式	进程网格	每进程线程数	求解时间/s	加速比
4	87 681	128		CPU	8×16		1 886.25	1.00
			1 024	CPU/DCU	4×4	8	267.41	7.05
6	87 681	192		CPU	12×16		1 271.63	1.00
			1 536	CPU/DCU	4×6	8	210.39	6.04
8	87 681	256		CPU	16×16		982.49	1.00
			2 048	CPU/DCU	4×8	8	177.66	5.53

节点数	核数	总时间/s	并行效率/%
360	103 680	2 805.57	100
720	207 360	1 700.20	82.50
1 440	414 720	864.11	81.17
2 160	622 080	611.95	76.41
3 600	1 036 800	381.60	73.50

Study of the parallel MoM on a domestic heterogeneous DCU platform

RichHTML

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 11

References 19

Related Articles 15

Metrics

Comments

Recommended 0

[1]	LI Minxuan,JIANG Shugang,WU Qingkai,LIN Zhongchao. Efficient communication method for transient electromagnetic field computation on unstructured grids [J]. Journal of Xidian University, 2022, 49(4): 16-23.
[2]	ZHAI Chang,LIN Zhongchao,ZHAO Xunwang,ZHANG Yu. Algorithm for half-space MLFMA domain decomposition utilizing an octree [J]. Journal of Xidian University, 2021, 48(6): 144-150.
[3]	SU Qin, GU Zongjing, LIN Zhongchao, ZHAO Xunwang, ZHANG Yu. Analysis of scattering characteristics of the one-thousand-wavelength object using the parallel IE-NDDM [J]. Journal of Xidian University, 2018, 45(6): 7-13.
[4]	JIANG Xuesong;JIANG Shugang;ZHANG Yu;ZHAO Xunwang. Parallel FDTD computation of million cores with the domestically-made many-core supercomputer [J]. Journal of Xidian University, 2017, 44(6): 65-69+128.
[5]	ZUO Sheng;CHEN Yan;ZHANG Yu;ZHAO Xunwang;LIN Zhongchao. Study of the scalable heterogeneous parallel out-of-core higher order method of moments [J]. Journal of Xidian University, 2017, 44(1): 146-151.
[6]	FANG Xiaoxing;ZHU Zhiyu;ZHANG Mingxin;LI Yang. Coupling influences of the radar electromagnetic field on the complex transmission line in an aperture cavity [J]. Journal of Xidian University, 2016, 43(6): 135-140.
[7]	CHEN Yan;ZHANG Yu;WANG Yong;ZHAO Xunwang;LIN Zhongchao. Optimization of matrix filling in the large scale parallel RWG basis based method of moments [J]. Journal of Xidian University, 2016, 43(5): 46-51.
[8]	JIANG Shugang;LIN Zhongchao;ZHANG Yu;WEI Bing;ZHAO Xunwang. Parallel FDTD computation of hundred thousand cores on a home-made supercomputer [J]. J4, 2015, 42(5): 86-91.
[9]	WANG Yong;LIN Zhongchao;ZHANG Yu;LIANG Changhong. Analysis of the radiation of slotted waveguide antennas using the parallel MoM [J]. J4, 2015, 42(5): 75-79+132.
[10]	LIN Zhongchao;CHEN Yan;ZHANG Yu;JIANG Shugang;ZHAO Xunwang;L Zhaofeng. Study of the parallel higher-order MoM on a domestically-made CPU platform [J]. J4, 2015, 42(3): 43-47.
[11]	Lü Zhengliang;GONG Shuxi;ZHANG Pengfei;CHEN Wenfeng;ZHAO Bo. Wide-band analysis using the modified IE-FFT and physical optical hybrid method [J]. J4, 2014, 41(5): 74-78.
[12]	WU Huixin;WANG Bing;CHAI Zhengyi. Spectrum allocation algorithm based on parallel immune optimization [J]. J4, 2014, 41(4): 111-115+136.
[13]	Lü Zhengliang;GONG Shuxi;ZHANG Pengfei;ZHAO Bo;WANG Fuwei. Fast frequency sweep analysis for antennas mounted on platforms using the wire-surface model [J]. J4, 2014, 41(1): 87-91.
[14]	WANG Wentao;WANG Fuwei;GONG Shuxi;WANG Xing. Array antenna pattern synthesis based on the implicit space mapping algorithm [J]. J4, 2012, 39(2): 159-163+199.
[15]	HE Zhili;HUANG Kai;JIANG Xiaobo;LIANG Changhong. Stable and efficient NURBS MOM-PO method [J]. J4, 2012, 39(1): 56-61.