Customizing Graph500 for Tianhe Pre-exacale system

02/02/2021
by   Xinbiao Gan, et al.
0

BFS (Breadth-First Search) is a typical graph algorithm used as a key component of many graph applications. However, current distributed parallel BFS implementations suffer from irregular data communication with large volumes of transfers across nodes, leading to inefficiency in performance. In this paper, we present a set of optimization techniques to improve the Graph500 performance for Pre-exacale system, including BFS accelerating with SVE (Scalable Vector extension) in matrix2000+, sorting with buffering for heavy vertices, and group-based monitor communication based on proprietary interconnection built in Tianhe Pre-exacale system. Performance evaluation on the customized Graph500 testing on the Tianhe Pre-exacale system achieves 2131.98 Giga TEPS on 512-node with 96608 cores, which surpasses the ranking of Tianhe-2 with about 16X fewer nodes in the June 2018 Graph500 list, and shows our customized Graph500 is 3.15 times faster on 512 nodes than the base version using the state-of-the-art techniques.

READ FULL TEXT

page 4

page 8

research
01/23/2020

Communication-Efficient String Sorting

There has been surprisingly little work on algorithms for sorting string...
research
06/10/2020

Anytime MiniBatch: Exploiting Stragglers in Online Distributed Optimization

Distributed optimization is vital in solving large-scale machine learnin...
research
03/17/2022

FUSED-PAGERANK: Loop-Fusion based Approximate PageRank

PageRank is a graph centrality metric that gives the importance of each ...
research
09/13/2022

Characterizing the Performance of Node-Aware Strategies for Irregular Point-to-Point Communication on Heterogeneous Architectures

Supercomputer architectures are trending toward higher computational thr...
research
11/11/2022

DistGNN-MB: Distributed Large-Scale Graph Neural Network Training on x86 via Minibatch Sampling

Training Graph Neural Networks, on graphs containing billions of vertice...
research
11/03/2021

How Neural Architectures Affect Deep Learning for Communication Networks?

In recent years, there has been a surge in applying deep learning to var...
research
11/22/2022

Kernelization of Discrete Optimization Problems on Parallel Architectures

There are existing standard solvers for tackling discrete optimization p...

Please sign up or login with your details

Forgot password? Click here to reset