A Programming Model for GPU Load Balancing

01/12/2023
by   Muhammad Osama, et al.
0

We propose a GPU fine-grained load-balancing abstraction that decouples load balancing from work processing and aims to support both static and dynamic schedules with a programmable interface to implement new load-balancing schedules. Prior to our work, the only way to unleash the GPU's potential on irregular problems has been to workload-balance through application-specific, tightly coupled load-balancing techniques. With our open-source framework for load-balancing, we hope to improve programmers' productivity when developing irregular-parallel algorithms on the GPU, and also improve the overall performance characteristics for such applications by allowing a quick path to experimentation with a variety of existing load-balancing techniques. Consequently, we also hope that by separating the concerns of load-balancing from work processing within our abstraction, managing and extending existing code to future architectures becomes easier.

READ FULL TEXT

page 4

page 10

research
12/17/2022

GPU Load Balancing

Fine-grained workload and resource balancing is the key to high performa...
research
04/23/2021

In-Situ Assessment of Device-Side Compute Work for Dynamic Load Balancing in a GPU-Accelerated PIC Code

Maintaining computational load balance is important to the performant be...
research
09/30/2017

An Efficient Load Balancing Method for Tree Algorithms

Nowadays, multiprocessing is mainstream with exponentially increasing nu...
research
10/01/2018

Heterogeneous MacroTasking (HeMT) for Parallel Processing in the Public Cloud

Using tiny, equal-sized tasks (Homogeneous microTasking, HomT) has long ...
research
06/03/2021

Exploiting co-execution with oneAPI: heterogeneity from a modern perspective

Programming efficiently heterogeneous systems is a major challenge, due ...
research
12/29/2022

Load Balancer Tuning: Comparative Analysis of HAProxy Load Balancing Methods

Load balancing is prevalent in practical application (e.g., web) deploym...
research
10/03/2022

Immunological Approaches to Load Balancing in MIMD Systems

Effective utilization of Multiple-Instruction-Multiple-Data (MIMD) paral...

Please sign up or login with your details

Forgot password? Click here to reset