Convergence of latent mixing measures in finite and infinite mixture models

09/15/2011
by   XuanLong Nguyen, et al.
0

This paper studies convergence behavior of latent mixing measures that arise in finite and infinite mixture models, using transportation distances (i.e., Wasserstein metrics). The relationship between Wasserstein distances on the space of mixing measures and f-divergence functionals such as Hellinger and Kullback-Leibler distances on the space of mixture distributions is investigated in detail using various identifiability conditions. Convergence in Wasserstein metrics for discrete measures implies convergence of individual atoms that provide support for the measures, thereby providing a natural interpretation of convergence of clusters in clustering applications where mixture models are typically employed. Convergence rates of posterior distributions for latent mixing measures are established, for both finite mixtures of multivariate distributions and infinite mixtures based on the Dirichlet process.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2020

Clustering of non-Gaussian data by variational Bayes for normal inverse Gaussian mixture models

Finite mixture models, typically Gaussian mixtures, are well known and w...
research
04/12/2020

Convergence of de Finetti's mixing measure in latent structure models for observed exchangeable sequences

Mixtures of product distributions are a powerful device for learning abo...
research
04/20/2023

Minimum Φ-distance estimators for finite mixing measures

Finite mixture models have long been used across a variety of fields in ...
research
02/17/2022

Refined Convergence Rates for Maximum Likelihood Estimation under Finite Mixture Models

We revisit convergence rates for maximum likelihood estimation (MLE) und...
research
06/09/2019

A general solver to the elliptical mixture model through an approximate Wasserstein manifold

This paper studies the problem of estimation for general finite mixture ...
research
09/15/2023

Augmented quantization: a general approach to mixture models

The investigation of mixture models is a key to understand and visualize...
research
05/25/2019

Combining mixture models with linear mixing updates: multilayer image segmentation and synthesis

Finite mixture models for clustering can often be improved by adding a r...

Please sign up or login with your details

Forgot password? Click here to reset