Rethinking k-means from manifold learning perspective

05/12/2023
by   Quanxue Gao, et al.
0

Although numerous clustering algorithms have been developed, many existing methods still leverage k-means technique to detect clusters of data points. However, the performance of k-means heavily depends on the estimation of centers of clusters, which is very difficult to achieve an optimal solution. Another major drawback is that it is sensitive to noise and outlier data. In this paper, from manifold learning perspective, we rethink k-means and present a new clustering algorithm which directly detects clusters of data without mean estimation. Specifically, we construct distance matrix between data points by Butterworth filter such that distance between any two data points in the same clusters equals to a small constant, while increasing the distance between other data pairs from different clusters. To well exploit the complementary information embedded in different views, we leverage the tensor Schatten p-norm regularization on the 3rd-order tensor which consists of indicator matrices of different views. Finally, an efficient alternating algorithm is derived to optimize our model. The constructed sequence was proved to converge to the stationary KKT point. Extensive experimental results indicate the superiority of our proposed method.

READ FULL TEXT

page 9

page 10

research
12/16/2020

Predictive K-means with local models

Supervised classification can be effective for prediction but sometimes ...
research
07/05/2019

Hybridized Threshold Clustering for Massive Data

As the size n of datasets become massive, many commonly-used clustering ...
research
05/25/2019

A New Clustering Method Based on Morphological Operations

With the booming development of data science, many clustering methods ha...
research
05/07/2014

Representative Selection for Big Data via Sparse Graph and Geodesic Grassmann Manifold Distance

This paper addresses the problem of identifying a very small subset of d...
research
12/03/2020

Manifold Learning and Deep Clustering with Local Dictionaries

We introduce a novel clustering algorithm for data sampled from a union ...
research
01/12/2017

Manifold Alignment Determination: finding correspondences across different data views

We present Manifold Alignment Determination (MAD), an algorithm for lear...
research
07/21/2022

A Dynamical Systems Algorithm for Clustering in Hyperspectral Imagery

In this paper we present a new dynamical systems algorithm for clusterin...

Please sign up or login with your details

Forgot password? Click here to reset