Distributed Asynchronous Union-Find for Scalable Feature Tracking

03/04/2020
by   Jiayi Xu, et al.
0

Feature tracking and the visualizations of the resulting trajectories make it possible to derive insights from scientific data and thus reduce the amount of data to be stored. However, existing serial methods are not scalable enough to handle fast increasing data size. In this paper, we tackle the problem of distributed parallelism for feature tracking and visualization by introducing a scalable, asynchronous union-find algorithm. We show that asynchronous communication can improve the scalability of distributed union-find operation in comparison to synchronous communication, as seen in existing methods. In the proposed feature tracking pipeline, we first construct and partition a high-dimensional mesh that incorporates both space and time. Then, the trajectories of features are built distributively across parallel processes, and trajectory pieces are merged asynchronously by using our distributed union-find implementation. Results demonstrate the scalability of tracking critical points on exploding wire experimental data and tracking super level sets on BOUT++ fusion plasma simulations.

READ FULL TEXT

page 4

page 5

page 8

research
11/17/2020

FTK: A Simplicial Spacetime Meshing Framework for Robust and Scalable Feature Tracking

We present the Feature Tracking Kit (FTK), a framework that simplifies, ...
research
04/23/2019

Block-distributed Gradient Boosted Trees

The Gradient Boosted Tree (GBT) algorithm is one of the most popular mac...
research
03/04/2022

Triggered Gradient Tracking for Asynchronous Distributed Optimization

This paper proposes Asynchronous Triggered Gradient Tracking, i.e., a di...
research
10/22/2018

Fantom: A scalable framework for asynchronous distributed systems

We describe Fantom, a framework for asynchronous distributed systems. Fa...
research
10/22/2017

Communication Dualism in Distributed Systems with Petri Net Interpretation

In the paper notion of communication dualism id formalized and explained...
research
07/21/2023

Robust Fully-Asynchronous Methods for Distributed Training over General Architecture

Perfect synchronization in distributed machine learning problems is inef...
research
10/20/2006

The intersection and the union of the asynchronous systems

The asynchronous systems f are the models of the asynchronous circuits f...

Please sign up or login with your details

Forgot password? Click here to reset