MPI Advance : Open-Source Message Passing Optimizations

09/13/2023
by   Amanda Bienz, et al.
0

The large variety of production implementations of the message passing interface (MPI) each provide unique and varying underlying algorithms. Each emerging supercomputer supports one or a small number of system MPI installations, tuned for the given architecture. Performance varies with MPI version, but application programmers are typically unable to achieve optimal performance with local MPI installations and therefore rely on whichever implementation is provided as a system install. This paper presents MPI Advance, a collection of libraries that sit on top of MPI, optimizing the underlying performance of any existing MPI library. The libraries provide optimizations for collectives, neighborhood collectives, partitioned communication, and GPU-aware communication.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2018

DMTCP Checkpoint/Restart of MPI Programs via Proxies

MPI accomplishes portable, standardized message-passing between processe...
research
06/02/2023

Optimizing Irregular Communication with Neighborhood Collectives and Locality-Aware Parallelism

Irregular communication often limits both the performance and scalabilit...
research
09/25/2019

Extending the Message Passing Interface (MPI) with User-Level Schedules

Composability is one of seven reasons for the long-standing and continui...
research
02/25/2021

The PetscSF Scalable Communication Layer

PetscSF, the communication component of the Portable, Extensible Toolkit...
research
06/23/2020

Optimised allgatherv, reduce_scatter and allreduce communication in message-passing systems

Collective communications, namely the patterns allgatherv, reduce_scatte...
research
10/25/2018

Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation

TensorFlow has been the most widely adopted Machine/Deep Learning framew...
research
03/06/2020

Distributed macroscopic traffic simulation with Open Traffic Models

This paper presents OTM-MPI, an extension of the Open Traffic Models pla...

Please sign up or login with your details

Forgot password? Click here to reset