A survey on Bayesian inference for Gaussian mixture model

08/20/2021
by   Jun Lu, et al.
232

Clustering has become a core technology in machine learning, largely due to its application in the field of unsupervised learning, clustering, classification, and density estimation. A frequentist approach exists to hand clustering based on mixture model which is known as the EM algorithm where the parameters of the mixture model are usually estimated into a maximum likelihood estimation framework. Bayesian approach for finite and infinite Gaussian mixture model generates point estimates for all variables as well as associated uncertainty in the form of the whole estimates' posterior distribution. The sole aim of this survey is to give a self-contained introduction to concepts and mathematical tools in Bayesian inference for finite and infinite Gaussian mixture model in order to seamlessly introduce their applications in subsequent sections. However, we clearly realize our inability to cover all the useful and interesting results concerning this field and given the paucity of scope to present this discussion, e.g., the separated analysis of the generation of Dirichlet samples by stick-breaking and Polya's Urn approaches. We refer the reader to literature in the field of the Dirichlet process mixture model for a much detailed introduction to the related fields. Some excellent examples include (Frigyik et al., 2010; Murphy, 2012; Gelman et al., 2014; Hoff, 2009). This survey is primarily a summary of purpose, significance of important background and techniques for Gaussian mixture model, e.g., Dirichlet prior, Chinese restaurant process, and most importantly the origin and complexity of the methods which shed light on their modern applications. The mathematical prerequisite is a first course in probability. Other than this modest background, the development is self-contained, with rigorous proofs provided throughout.

READ FULL TEXT

page 19

page 20

page 23

page 27

page 28

page 33

page 34

page 37

research
07/06/2021

Numerical Matrix Decomposition and its Modern Applications: A Rigorous First Course

Matrix decomposition has become a core technology in machine learning, l...
research
04/08/2019

Classification of pulsars with Dirichlet process Gaussian mixture model

Young isolated neutron stars (INS) most commonly manifest themselves as ...
research
03/08/2019

Computer code validation via mixture model estimation

When computer codes are used for modeling complex physical systems, thei...
research
11/28/2018

Statistical Robust Chinese Remainder Theorem for Multiple Numbers: Wrapped Gaussian Mixture Model

Generalized Chinese Remainder Theorem (CRT) has been shown to be a power...
research
02/18/2023

Bayesian Matrix Decomposition and Applications

The sole aim of this book is to give a self-contained introduction to co...
research
10/30/2020

Sensor-based localization of epidemic sources on human mobility networks

We investigate the source detection problem in epidemiology, which is on...
research
01/04/2023

A Bayesian mixture model captures temporal and spatial structure of voting blocs within longitudinal referendum data

The estimation of voting blocs is an important statistical inquiry in po...

Please sign up or login with your details

Forgot password? Click here to reset