A New Parallel Adaptive Clustering and its Application to Streaming Data

04/06/2021
by   Benjamin McLaughlin, et al.
0

This paper presents a parallel adaptive clustering (PAC) algorithm to automatically classify data while simultaneously choosing a suitable number of classes. Clustering is an important tool for data analysis and understanding in a broad set of areas including data reduction, pattern analysis, and classification. However, the requirement to specify the number of clusters in advance and the computational burden associated with clustering large sets of data persist as challenges in clustering. We propose a new parallel adaptive clustering (PAC) algorithm that addresses these challenges by adaptively computing the number of clusters and leveraging the power of parallel computing. The algorithm clusters disjoint subsets of the data on parallel computation threads. We develop regularized set k-means to efficiently cluster the results from the parallel threads. A refinement step further improves the clusters. The PAC algorithm offers the capability to adaptively cluster data sets which change over time by reusing the information from previous time steps to decrease computation. We provide theoretical analysis and numerical experiments to characterize the performance of the method, validate its properties, and demonstrate the computational efficiency of the method.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 22

03/16/2021

K-expectiles clustering

K-means clustering is one of the most widely-used partitioning algorithm...
10/05/2021

Fast and Interpretable Consensus Clustering via Minipatch Learning

Consensus clustering has been widely used in bioinformatics and other ap...
09/24/2021

Adaptive Clustering-based Reduced-Order Modeling Framework: Fast and accurate modeling of localized history-dependent phenomena

This paper proposes a novel Adaptive Clustering-based Reduced-Order Mode...
03/09/2020

Probabilistic Partitive Partitioning (PPP)

Clustering is a NP-hard problem. Thus, no optimal algorithm exists, heur...
07/11/2014

Density Adaptive Parallel Clustering

In this paper we are going to introduce a new nearest neighbours based a...
09/26/2017

Adaptive Nonparametric Clustering

This paper presents a new approach to non-parametric cluster analysis ca...
11/12/2019

Coordination Group Formation for OnLine Coordinated Routing Mechanisms

This study considers that the collective route choices of travelers en r...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.