Bayesian clustering of high-dimensional data

06/04/2020
by   Noirrit Kiran Chandra, et al.
0

In many applications, it is of interest to cluster subjects based on very high-dimensional data. Although Bayesian discrete mixture models are often successful at model-based clustering, we demonstrate pitfalls in high-dimensional settings. The first key problem is a tendency for posterior sampling algorithms based on Markov chain Monte Carlo to produce a very large number of clusters that slowly decreases as sampling proceeds, indicating serious mixing problems. The second key problem is that the true posterior also has aberrant behavior but potentially in the opposite direction. In particular, we show that, for diverging dimension and fixed sample size, the true posterior either assigns each observation to a different cluster or all observations to the same cluster, depending on the kernels and prior specification. We propose a general strategy for solving these problems by basing clustering on a discrete mixture model for a low-dimensional latent variable. We refer to this class of methods as LAtent Mixtures for Bayesian (Lamb) clustering. Theoretical support is provided, and we illustrate substantial gains relative to clustering on the observed data level in simulation studies. The methods are motivated by an application to clustering of single cell RNAseq data, with the clusters corresponding to different cell types.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2023

Bayesian clustering of high-dimensional data via latent repulsive mixtures

Model-based clustering of moderate or large dimensional data is notoriou...
research
08/09/2014

Warped Mixtures for Nonparametric Cluster Shapes

A mixture of Gaussians fit to a single curved or heavy-tailed cluster wi...
research
07/06/2021

T-LoHo: A Bayesian Regularization Model for Structured Sparsity and Smoothness on Graphs

Many modern complex data can be represented as a graph. In models dealin...
research
03/31/2023

Bayesian Clustering via Fusing of Localized Densities

Bayesian clustering typically relies on mixture models, with each compon...
research
03/31/2020

Distributed Bayesian clustering

In many modern applications, there is interest in analyzing enormous dat...
research
07/04/2020

Cluster Prediction for Opinion Dynamics from Partial Observations

We present a Bayesian approach to predict the clustering of opinions for...
research
05/05/2021

A Bayesian latent allocation model for clustering compositional data with application to the Great Barrier Reef

Relative abundance is a common metric to estimate the composition of spe...

Please sign up or login with your details

Forgot password? Click here to reset