Evidence estimation in finite and infinite mixture models and applications

05/11/2022
by   Adrien Hairault, et al.
0

Estimating the model evidence - or mariginal likelihood of the data - is a notoriously difficult task for finite and infinite mixture models and we reexamine here different Monte Carlo techniques advocated in the recent literature, as well as novel approaches based on Geyer (1994) reverse logistic regression technique, Chib (1995) algorithm, and Sequential Monte Carlo (SMC). Applications are numerous. In particular, testing for the number of components in a finite mixture model or against the fit of a finite mixture model for a given dataset has long been and still is an issue of much interest, albeit yet missing a fully satisfactory resolution. Using a Bayes factor to find the right number of components K in a finite mixture model is known to provide a consistent procedure. We furthermore establish the consistence of the Bayes factor when comparing a parametric family of finite mixtures against the nonparametric 'strongly identifiable' Dirichlet Process Mixture (DPM) model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/30/2016

An Operator Theoretic Approach to Nonparametric Mixture Models

When estimating finite mixture models, it is common to make assumptions ...
research
05/24/2020

Estimating the Number of Components in Finite Mixture Models via the Group-Sort-Fuse Procedure

Estimation of the number of components (or order) of a finite mixture mo...
research
08/02/2012

Multidimensional Membership Mixture Models

We present the multidimensional membership mixture (M3) models where eve...
research
03/19/2021

Order selection with confidence for finite mixture models

The determination of the number of mixture components (the order) of a f...
research
07/08/2020

Finite mixture models are typically inconsistent for the number of components

Scientists and engineers are often interested in learning the number of ...
research
07/04/2019

An enriched mixture model for functional clustering

There is an increasingly rich literature about Bayesian nonparametric mo...
research
07/14/2018

On the Identifiability of Finite Mixtures of Finite Product Measures

The problem of identifiability of finite mixtures of finite product meas...

Please sign up or login with your details

Forgot password? Click here to reset