Scalable Edge Partitioning

08/20/2018
by   Sebastian Schlag, et al.
0

Edge-centric distributed computations have appeared as a recent technique to improve the shortcomings of think-like-a-vertex algorithms on large scale-free networks. In order to increase parallelism on this model, edge partitioning - partitioning edges into roughly equally sized blocks - has emerged as an alternative to traditional (node-based) graph partitioning. In this work, we give a distributed memory parallel algorithm to compute high-quality edge partitions in a scalable way. Our algorithm scales to networks with billions of edges, and runs efficiently on thousands of PEs. Our technique is based on a fast parallelization of split graph construction and a use of advanced node partitioning algorithms. Our extensive experiments show that our algorithm has high quality on large real-world networks and large hyperbolic random graphs, which have a power law degree distribution and are therefore specifically targeted by edge partitioning

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/18/2021

Time-Efficient and High-Quality Graph Partitioning for Graph Dynamic Scaling

The dynamic scaling of distributed computations plays an important role ...
research
08/16/2019

Distributed Edge Partitioning for Trillion-edge Graphs

We propose Distributed Neighbor Expansion (Distributed NE), a parallel a...
research
02/20/2018

ILP-based Local Search for Graph Partitioning

Computing high-quality graph partitions is a challenging problem with nu...
research
11/01/2019

A Simple and Efficient Method to Compute a Single Linkage Dendrogram

We address the problem of computing a single linkage dendrogram. A possi...
research
12/11/2018

DRONE: a Distributed Subgraph-Centric Framework for Processing Large Scale Power-law Graphs

Nowadays, in the big data era, social networks, graph databases, knowled...
research
12/11/2018

DRONE: a Distributed gRaph cOmputiNg Engine

Nowadays, in big data era, social networks, graph database, knowledge gr...
research
04/18/2014

Parallel Graph Partitioning for Complex Networks

Processing large complex networks like social networks or web graphs has...

Please sign up or login with your details

Forgot password? Click here to reset