Alleviating Label Switching with Optimal Transport

11/05/2019
by   Pierre Monteiller, et al.
25

Label switching is a phenomenon arising in mixture model posterior inference that prevents one from meaningfully assessing posterior statistics using standard Monte Carlo procedures. This issue arises due to invariance of the posterior under actions of a group; for example, permuting the ordering of mixture components has no effect on the likelihood. We propose a resolution to label switching that leverages machinery from optimal transport. Our algorithm efficiently computes posterior statistics in the quotient space of the symmetry group. We give conditions under which there is a meaningful solution to label switching and demonstrate advantages over alternative approaches on simulated and real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2021

Optimal transport couplings of Gibbs samplers on partitions for unbiased estimation

Computational couplings of Markov chains provide a practical route to un...
research
03/27/2018

Approximate Bayesian Computation for Finite Mixture Models

Finite mixture models are used in statistics and other disciplines, but ...
research
09/20/2019

Sequential Ensemble Transform for Bayesian Inverse Problems

We present the Sequential Ensemble Transform (SET) method, a new approac...
research
05/28/2018

Bayesian Learning with Wasserstein Barycenters

In this work we introduce a novel paradigm for Bayesian learning based o...
research
07/08/2020

Finite mixture models are typically inconsistent for the number of components

Scientists and engineers are often interested in learning the number of ...
research
10/01/2013

Summary Statistics for Partitionings and Feature Allocations

Infinite mixture models are commonly used for clustering. One can sample...

Please sign up or login with your details

Forgot password? Click here to reset