节点文献

面对E级超算系统的可扩展性和效率挑战:神威E级原型系统并行支撑环境的实践(英文)

Scalability and efficiency challenges for the exascale supercomputing system:practice of a parallel supporting environment on the Sunway exascale prototype system

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 何晓斌陈鑫郭恒刘鑫陈德训杨雨灵高洁冯赟龙陈龙得刁晓娜陈左宁

【Author】 Xiaobin HE§;Xin CHEN§;Heng GUO;Xin LIU;Dexun CHEN;Yuling YANG;Jie GAO;Yunlong FENG;Longde CHEN;Xiaona DIAO;Zuoning CHEN;National Research Center of Parallel Computer Engineering and Technology;

【通讯作者】 刘鑫;陈德训;

【机构】 国家并行计算机工程与技术研究中心

【摘要】 随着超级计算机性能不断提高,人工智能与传统科学计算的进一步融合,应用的并行规模逐渐增加,从数百万个计算核心到数千万个计算核心,这对超大规模系统上实现并行应用的高可扩展性和高效率提出巨大挑战。本文首先以神威E级原型系统为例,分析了E级时代并行应用的高可扩展性和高效率面临的挑战。为克服这些挑战,重点介绍了神威E级原型系统上并行支撑环境软件的优化技术,包括并行操作系统、I/O优化技术、超大规模并行调试技术、千万核心并行算法、混合精度方法等。并行操作系统和I/O优化技术主要支持大规模系统扩展,而超大规模并行调试技术、千万核心并行算法和混合精度方法主要提升大规模应用的效率。最后,介绍了运行在神威E级原型系统上的应用程序取得的重要成果,从而验证了并行支撑环境设计的有效性。

【Abstract】 With the continuous improvement of supercomputer performance and the integration of arti?cial intelligence with traditional scienti?c computing,the scale of applications is gradually increasing,from millions to tens of millions of computing cores,which raises great challenges to achieve high scalability and e?ciency of parallel applications on super-large-scale systems.Taking the Sunway exascale prototype system as an example,in this paper we?rst analyze the challenges of high scalability and high e?ciency for parallel applications in the exascale era.To overcome these challenges,the optimization technologies used in the parallel supporting environment software on the Sunway exascale prototype system are highlighted,including the parallel operating system,input/output(I/O) optimization technology,ultra-large-scale parallel debugging technology,10-million-core parallel algorithm,and mixed-precision method.Parallel operating systems and I/O optimization technology mainly support largescale system scaling,while the ultra-large-scale parallel debugging technology,10-million-core parallel algorithm,and mixed-precision method mainly enhance the e?ciency of large-scale applications.Finally,the contributions to various applications running on the Sunway exascale prototype system are introduced,verifying the e?ectiveness of the parallel supporting environment design.

【基金】 Project supported by the Key R&D Program of Zhejiang Province,China (No.2022C01250);the National Key R&D Program of China (No.2019YFA0709402)
  • 【文献出处】 Frontiers of Information Technology & Electronic Engineering ,信息与电子工程前沿(英文) , 编辑部邮箱 ,2023年01期
  • 【分类号】TP338.4
  • 【下载频次】22
节点文献中: 

本文链接的文献网络图示:

本文的引文网络