Clustering of Data with Missing Entries using Non-convex Fusion Penalties

09/06/2017
by   Sunrita Poddar, et al.
0

The presence of missing entries in data often creates challenges for pattern recognition algorithms. Traditional algorithms for clustering data assume that all the feature values are known for every data point. We propose a method to cluster data in the presence of missing information. Unlike conventional clustering techniques where every feature is known for each point, our algorithm can handle cases where a few feature values are unknown for every point. For this more challenging problem, we provide theoretical guarantees for clustering using a ℓ_0 fusion penalty based optimization problem. Furthermore, we propose an algorithm to solve a relaxation of this problem using saturating non-convex fusion penalties. It is observed that this algorithm produces solutions that degrade gradually with an increase in the fraction of missing feature values. We demonstrate the utility of the proposed method using a simulated dataset, the Wine dataset and also an under-sampled cardiac MRI dataset. It is shown that the proposed method is a promising clustering technique for datasets with large fractions of missing entries.

READ FULL TEXT
research
01/03/2018

Clustering of Data with Missing Entries

The analysis of large datasets is often complicated by the presence of m...
research
01/01/2018

Theoretical Analysis of Sparse Subspace Clustering with Missing Entries

Sparse Subspace Clustering (SSC) is a popular unsupervised machine learn...
research
02/26/2019

Optimal Clustering with Missing Values

Missing values frequently arise in modern biomedical studies due to vari...
research
01/01/2021

TenIPS: Inverse Propensity Sampling for Tensor Completion

Tensors are widely used to represent multiway arrays of data. The recove...
research
03/01/2018

Interval-based Prediction Uncertainty Bound Computation in Learning with Missing Values

The problem of machine learning with missing values is common in many ar...
research
06/23/2019

Robust convex clustering: How does fusion penalty enhance robustness?

Convex clustering has gained popularity recently due to its desirable pe...
research
02/27/2014

An Effective Evolutionary Clustering Algorithm: Hepatitis C Case Study

Clustering analysis plays an important role in scientific research and c...

Please sign up or login with your details

Forgot password? Click here to reset