Combinatorial BLAS 2.0: Scaling combinatorial algorithms on distributed-memory systems

06/28/2021
by   Ariful Azad, et al.
0

Combinatorial algorithms such as those that arise in graph analysis, modeling of discrete systems, bioinformatics, and chemistry, are often hard to parallelize. The Combinatorial BLAS library implements key computational primitives for rapid development of combinatorial algorithms in distributed-memory systems. During the decade since its first introduction, the Combinatorial BLAS library has evolved and expanded significantly. This paper details many of the key technical features of Combinatorial BLAS version 2.0, such as communication avoidance, hierarchical parallelism via in-node multithreading, accelerator support via GPU kernels, generalized semiring support, implementations of key data structures and functions, and scalable distributed I/O operations for human-readable files. Our paper also presents several rules of thumb for choosing the right data structures and functions in Combinatorial BLAS 2.0, under various common application scenarios.

READ FULL TEXT

page 4

page 6

page 13

research
11/19/2016

dMath: Distributed Linear Algebra for DL

The paper presents a parallel math library, dMath, that demonstrates lea...
research
04/05/2016

dMath: A Scalable Linear Algebra and Math Library for Heterogeneous GP-GPU Architectures

A new scalable parallel math library, dMath, is presented in this paper ...
research
10/04/2019

RDMA vs. RPC for Implementing Distributed Data Structures

Distributed data structures are key to implementing scalable application...
research
08/24/2023

Alternative quadrant representations with Morton index and AVX2 vectorization for AMR algorithms within the p4est software library

We present a technical enhancement within the p4est software for paralle...
research
09/28/2015

Encoding Reality: Prediction-Assisted Cortical Learning Algorithm in Hierarchical Temporal Memory

In the decade since Jeff Hawkins proposed Hierarchical Temporal Memory (...
research
08/29/2019

Improving the Performance of the Paisley Pattern-Matching EDSL by Staged Combinatorial Compilation

Paisley is a declarative lightweight embedded domain-specific language f...
research
11/19/2021

Uniform Brackets, Containers, and Combinatorial Macbeath Regions

We study the connections between three seemingly different combinatorial...

Please sign up or login with your details

Forgot password? Click here to reset