Entropy K-Means Clustering With Feature Reduction Under Unknown Number of Clusters

06/04/2021
by   Kristina P Sinaga, et al.
0

The k-means algorithm with its extensions is the most used clustering method in the literature. But, the k-means and its various extensions are generally affected by initializations with a given number of clusters. On the other hand, most of k-means always treat data points with equal importance for feature components. There are several feature-weighted k-means proposed in literature, but, these feature-weighted k-means do not give a feature reduction behavior. In this paper, based on several entropy-regularized terms we can construct a novel k-means clustering algorithm, called Entropy-k-means, such that it can be free of initializations without a given number of clusters, and also has a feature reduction behavior. That is, the proposed Entropy-k-means algorithm can eliminate irrelevant features with feature reduction under free of initializations with automatically finding an optimal number of clusters. Comparisons between the proposed Entropy-k-means and other methods are made. Experimental results and comparisons actually demonstrate these good aspects of the proposed Entropy-k-means with its effectiveness and usefulness in practice.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 8

page 11

page 12

page 13

research
04/25/2020

Unsupervised K-Means Clustering Algorithm

The k-means algorithm is generally the most known and used clustering me...
research
02/28/2017

A description length approach to determining the number of k-means clusters

We present an asymptotic criterion to determine the optimal number of cl...
research
02/15/2017

On the Discrepancy Between Kleinberg's Clustering Axioms and k-Means Clustering Algorithm Behavior

This paper investigates the validity of Kleinberg's axioms for clusterin...
research
08/15/2023

Parametric entropy based Cluster Centriod Initialization for k-means clustering of various Image datasets

One of the most employed yet simple algorithm for cluster analysis is th...
research
09/13/2022

A Clustering Method Based on Information Entropy Payload

Existing clustering algorithms such as K-means often need to preset para...
research
03/22/2017

Clustering for Different Scales of Measurement - the Gap-Ratio Weighted K-means Algorithm

This paper describes a method for clustering data that are spread out ov...
research
04/15/2020

A Feature-Reduction Multi-View k-Means Clustering Algorithm

The k-means clustering algorithm is the oldest and most known method in ...

Please sign up or login with your details

Forgot password? Click here to reset