Probabilistic K-means Clustering via Nonlinear Programming

01/10/2020
by   Yujian Li, et al.
0

K-means is a classical clustering algorithm with wide applications. However, soft K-means, or fuzzy c-means at m=1, remains unsolved since 1981. To address this challenging open problem, we propose a novel clustering model, i.e. Probabilistic K-Means (PKM), which is also a nonlinear programming model constrained on linear equalities and linear inequalities. In theory, we can solve the model by active gradient projection, while inefficiently. Thus, we further propose maximum-step active gradient projection and fast maximum-step active gradient projection to solve it more efficiently. By experiments, we evaluate the performance of PKM and how well the proposed methods solve it in five aspects: initialization robustness, clustering performance, descending stability, iteration number, and convergence speed.

READ FULL TEXT
research
07/23/2020

Scalable Initialization Methods for Large-Scale Clustering

In this work, two new initialization methods for K-means clustering are ...
research
12/07/2022

On the Global Solution of Soft k-Means

This paper presents an algorithm to solve the Soft k-Means problem globa...
research
11/08/2017

Clustering with feature selection using alternating minimization, Application to computational biology

This paper deals with unsupervised clustering with feature selection. Th...
research
08/22/2018

k-meansNet: When k-means Meets Differentiable Programming

In this paper, we study how to make clustering benefiting from different...
research
03/16/2020

Clustering-Based Model Order Reduction for Nonlinear Network Systems

Clustering by projection has been proposed as a way to preserve network ...
research
07/17/2019

t-k-means: A k-means Variant with Robustness and Stability

Lloyd's k-means algorithm is one of the most classical clustering method...
research
08/19/2019

Robust and Efficient Fuzzy C-Means Clustering Constrained on Flexible Sparsity

Clustering is an effective technique in data mining to group a set of ob...

Please sign up or login with your details

Forgot password? Click here to reset