Parallel Batch-Dynamic Minimum Spanning Forest and the Efficiency of Dynamic Agglomerative Graph Clustering

05/10/2022
by   Tom Tseng, et al.
0

Hierarchical agglomerative clustering (HAC) is a popular algorithm for clustering data, but despite its importance, no dynamic algorithms for HAC with good theoretical guarantees exist. In this paper, we study dynamic HAC on edge-weighted graphs. As single-linkage HAC reduces to computing a minimum spanning forest (MSF), our first result is a parallel batch-dynamic algorithm for maintaining MSFs. On a batch of k edge insertions or deletions, our batch-dynamic MSF algorithm runs in O(klog^6 n) expected amortized work and O(log^4 n) span with high probability. It is the first fully dynamic MSF algorithm handling batches of edge updates with polylogarithmic work per update and polylogarithmic span. Using our MSF algorithm, we obtain a parallel batch-dynamic algorithm that can answer queries about single-linkage graph HAC clusters. Our second result is that dynamic graph HAC is significantly harder for other common linkage functions. For example, assuming the strong exponential time hypothesis, dynamic graph HAC requires Ω(n^1-o(1)) work per update or query on a graph with n vertices for complete linkage, weighted average linkage, and average linkage. For complete linkage and weighted average linkage, the bound still holds even for incremental or decremental algorithms and even if we allow poly(n)-approximation. For average linkage, the bound weakens to Ω(n^1/2 - o(1)) for incremental and decremental algorithms, and the bounds still hold when allowing n^o(1)-approximation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2020

Work-efficient Batch-incremental Minimum Spanning Trees with Applications to the Sliding Window Model

Algorithms for dynamically maintaining minimum spanning trees (MSTs) hav...
research
02/18/2020

Dynamic Graph Algorithms with Batch Updates in the Massively Parallel Computation Model

We study dynamic graph algorithms in the Massively Parallel Computation ...
research
03/30/2020

Parallel Batch-Dynamic k-Clique Counting

In this paper, we study new batch-dynamic algorithms for k-clique counti...
research
03/21/2019

Parallel Batch-Dynamic Graph Connectivity

With the rapid growth of graph datasets over the past decade, a new kind...
research
08/26/2021

Dynamic Structural Clustering on Graphs

Structural Clustering (DynClu) is one of the most popular graph clusteri...
research
02/12/2020

Batch-dynamic Algorithms via Parallel Change Propagation and Applications to Dynamic Trees

Dynamic algorithms capable of supporting batches of updates are increasi...
research
05/15/2020

Input-dynamic distributed graph algorithms for congested networks

Consider a distributed system, where the topology of the communication n...

Please sign up or login with your details

Forgot password? Click here to reset