Too Much Information Kills Information: A Clustering Perspective

by   Yicheng Xu, et al.

Clustering is one of the most fundamental tools in the artificial intelligence area, particularly in the pattern recognition and learning theory. In this paper, we propose a simple, but novel approach for variance-based k-clustering tasks, included in which is the widely known k-means clustering. The proposed approach picks a sampling subset from the given dataset and makes decisions based on the data information in the subset only. With certain assumptions, the resulting clustering is provably good to estimate the optimum of the variance-based objective with high probability. Extensive experiments on synthetic datasets and real-world datasets show that to obtain competitive results compared with k-means method (Llyod 1982) and k-means++ method (Arthur and Vassilvitskii 2007), we only need 7 up to 15 k-means method and k-means++ method in at least 80 terms of the quality of clustering. Also, an extended algorithm based on the same idea guarantees a balanced k-clustering result.



There are no comments yet.


page 3


Hybrid data clustering approach using K-Means and Flower Pollination Algorithm

Data clustering is a technique for clustering set of objects into known ...

Multiple Kernel k-Means Clustering by Selecting Representative Kernels

To cluster data that are not linearly separable in the original feature ...

PQk-means: Billion-scale Clustering for Product-quantized Codes

Data clustering is a fundamental operation in data analysis. For handlin...

A Simple Approach to Sparse Clustering

Consider the problem of sparse clustering, where it is assumed that only...

Clustering Algorithms: A Comparative Approach

Many real-world systems can be studied in terms of pattern recognition t...

KohonAnts: A Self-Organizing Ant Algorithm for Clustering and Pattern Classification

In this paper we introduce a new ant-based method that takes advantage o...

Decorrelated Clustering with Data Selection Bias

Most of existing clustering algorithms are proposed without considering ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.