In-Situ Assessment of Device-Side Compute Work for Dynamic Load Balancing in a GPU-Accelerated PIC Code

04/23/2021
by   Michael E. Rowan, et al.
0

Maintaining computational load balance is important to the performant behavior of codes which operate under a distributed computing model. This is especially true for GPU architectures, which can suffer from memory oversubscription if improperly load balanced. We present enhancements to traditional load balancing approaches and explicitly target GPU architectures, exploring the resulting performance. A key component of our enhancements is the introduction of several GPU-amenable strategies for assessing compute work. These strategies are implemented and benchmarked to find the most optimal data collection methodology for in-situ assessment of GPU compute work. For the fully kinetic particle-in-cell code WarpX, which supports MPI+CUDA parallelism, we investigate the performance of the improved dynamic load balancing via a strong scaling-based performance model and show that, for a laser-ion acceleration test problem run with up to 6144 GPUs on Summit, the enhanced dynamic load balancing achieves from 62 the theoretically predicted maximum speedup; for the 96-GPU case, we find that dynamic load balancing improves performance relative to baselines without load balancing (3.8x speedup) and with static load balancing (1.2x speedup). Our results provide important insights into dynamic load balancing and performance assessment, and are particularly relevant in the context of distributed memory applications ran on GPUs.

READ FULL TEXT

page 4

page 5

page 7

research
01/12/2023

A Programming Model for GPU Load Balancing

We propose a GPU fine-grained load-balancing abstraction that decouples ...
research
02/09/2021

Multi-GPU SNN Simulation with Static Load Balancing

We present a SNN simulator which scales to millions of neurons, billions...
research
05/20/2019

Exploiting Parallelism on Shared Memory in the QED Particle-in-Cell Code PICADOR with Greedy Load Balancing

State-of-the-art numerical simulations of laser plasma by means of the P...
research
08/16/2022

Performance Assessment of Diffusive Load Balancing for Distributed Particle Advection

Particle advection is the approach for extraction of integral curves fro...
research
11/01/2017

Dynamic Load Balancing Strategies for Graph Applications on GPUs

Acceleration of graph applications on GPUs has found large interest due ...
research
07/02/2018

Dynamic load balancing strategies for hierarchical p-FEM solvers

Equation systems resulting from a p-version FEM discretisation typically...
research
02/16/2019

A Timer-Augmented Cost Function for Load Balanced DSMC

Due to a hard dependency between time steps, large-scale simulations of ...

Please sign up or login with your details

Forgot password? Click here to reset