DeepAI AI Chat
Log In Sign Up

Alleviating Label Switching with Optimal Transport

by   Pierre Monteiller, et al.

Label switching is a phenomenon arising in mixture model posterior inference that prevents one from meaningfully assessing posterior statistics using standard Monte Carlo procedures. This issue arises due to invariance of the posterior under actions of a group; for example, permuting the ordering of mixture components has no effect on the likelihood. We propose a resolution to label switching that leverages machinery from optimal transport. Our algorithm efficiently computes posterior statistics in the quotient space of the symmetry group. We give conditions under which there is a meaningful solution to label switching and demonstrate advantages over alternative approaches on simulated and real data.


page 1

page 2

page 3

page 4


Optimal transport couplings of Gibbs samplers on partitions for unbiased estimation

Computational couplings of Markov chains provide a practical route to un...

Approximate Bayesian Computation for Finite Mixture Models

Finite mixture models are used in statistics and other disciplines, but ...

Sequential Ensemble Transform for Bayesian Inverse Problems

We present the Sequential Ensemble Transform (SET) method, a new approac...

Bayesian Learning with Wasserstein Barycenters

In this work we introduce a novel paradigm for Bayesian learning based o...

Finite mixture models are typically inconsistent for the number of components

Scientists and engineers are often interested in learning the number of ...

Summary Statistics for Partitionings and Feature Allocations

Infinite mixture models are commonly used for clustering. One can sample...