Qiu, H, Xu, C, Li, D et al. (3 more authors) (2022) Parallelizing and Balancing Coupled DSMC/PIC for Large-scale Particle Simulations. In: 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 30 May - 03 Jun 2022, Lyon, France. IEEE , pp. 390-401. ISBN 978-1-6654-8107-6
Abstract
In high-performance and parallel computing, an important application class is particle simulation. Due to massive particle migration among distributed simulation workers across simulation iterations, achieving balanced runtime work distribution is vital for accelerating large-scale realistic particle simulations. This paper proposes a novel approach to enable dynamic load balance for distributed numerical particle simulations, specifically targeting the latest coupled DSMC/PI C method. Unlike prior work, our approach adopts a dual, nested unstructured grid organization to facilitate coupled DSMC/PIC computation and runtime grid distribution. Our implementation leverages both centralized and distributed communication strategies to dynamically migrate particles among arbitrary parallel processes. It then employs a load balancer - driven by a carefully designed analytical model and a grid remapping mechanism - to dynamically redistribute the simulation workloads among parallel simulation workers. By constantly monitoring and redis-tributing the simulation work across workers, our approach can adapt to the change of particle distribution across simulation iterations, avoiding a few workers becoming the performance bottleneck of the entire simulation process. We integrate our techniques into a coupled DSMC/PIC solver and apply them to simulate the plasma plume with hydrogen atoms and ions. Experimental results show that our approach can scale well up to 1500+ processes with billions of particles, exhibiting the state-of-the-art parallel simulation scalability and efficiency for plasma plume simulation.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Keywords: | Coupled DSMC/PIC; Particle simulation; Dynamic load balance |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) |
Funding Information: | Funder Grant number Royal Society IEC\NSFC\191465 |
Depositing User: | Symplectic Publications |
Date Deposited: | 16 Mar 2022 12:39 |
Last Modified: | 11 Oct 2023 15:21 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/IPDPS53621.2022.00045 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:184746 |