VEBO: A Vertex- and Edge-Balanced Ordering Heuristic to Load Balance Parallel Graph Processing

06/18/2018
by   Jiawen Sun, et al.
0

Graph partitioning drives graph processing in distributed, disk-based and NUMA-aware systems. A commonly used partitioning goal is to balance the number of edges per partition in conjunction with minimizing the edge or vertex cut. While this type of partitioning is computationally expensive, we observe that such topology-driven partitioning nonetheless results in computational load imbalance. We propose Vertex- and Edge-Balanced Ordering (VEBO): balance the number of edges and the number of unique destinations of those edges. VEBO optimally balances edges and vertices for graphs with a power-law degree distribution. Experimental evaluation on three shared-memory graph processing systems (Ligra, Polymer and GraphGrind) shows that VEBO achieves excellent load balance and improves performance by 1.09x over Ligra, 1.41x over Polymer and 1.65x over GraphGrind, compared to their respective partitioning algorithms, averaged across 8 algorithms and 7 graphs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/05/2019

Window-based Streaming Graph Partitioning Algorithm

In the recent years, the scale of graph datasets has increased to such a...
research
02/10/2019

Multi-Dimensional Balanced Graph Partitioning via Projected Gradient Descent

Motivated by performance optimization of large-scale graph processing sy...
research
07/06/2020

Prioritized Restreaming Algorithms for Balanced Graph Partitioning

Balanced graph partitioning is a critical step for many large-scale dist...
research
05/29/2019

Evaluating structure learning algorithms with a balanced scoring function

Several structure learning algorithms have been proposed towards discove...
research
07/15/2019

Partitioning Graphs for the Cloud using Reinforcement Learning

In this paper, we propose Revolver, a parallel graph partitioning algori...
research
02/09/2021

Balanced Districting on Grid Graphs with Provable Compactness and Contiguity

Given a graph G = (V,E) with vertex weights w(v) and a desired number of...
research
10/01/2012

Think Locally, Act Globally: Perfectly Balanced Graph Partitioning

We present a novel local improvement scheme for the perfectly balanced g...

Please sign up or login with your details

Forgot password? Click here to reset