On the Bias of the Score Function of Finite Mixture Models

02/09/2020
by   Rodrigo Labouriau, et al.
0

We characterize the unbiasedness of the score function, viewed as an inference function, for a class of finite mixture models. The models studied represent the situation where there is a stratification of the observations in a finite number of groups. We show that if the observations belonging to the same group follow the same distribution and the K distributions associated with each group are distinct elements of a sufficiently regular parametric family of probability measures, then the score function for estimating the parameters identifying the distribution of each group is unbiased. However, if one introduces a mixture in the scenario described above, so that for some observations it is only known that they belong to some of the groups with a given probability (not all in 0, 1), then the score function becomes biased. We argue then that under further mild regularity conditions, the maximum likelihood estimate is not consistent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2015

On The Identifiability of Mixture Models from Grouped Samples

Finite mixture models are statistical models which appear in many proble...
research
06/30/2016

An Operator Theoretic Approach to Nonparametric Mixture Models

When estimating finite mixture models, it is common to make assumptions ...
research
06/12/2020

Consistent Estimation of Identifiable Nonparametric Mixture Models from Grouped Observations

Recent research has established sufficient conditions for finite mixture...
research
03/27/2018

Approximate Bayesian Computation for Finite Mixture Models

Finite mixture models are used in statistics and other disciplines, but ...
research
11/12/2014

On Coarse Graining of Information and Its Application to Pattern Recognition

We propose a method based on finite mixture models for classifying a set...
research
04/21/2020

Identifiability and consistency of network inference using the hub model and variants: a restricted class of Bernoulli mixture models

Statistical network analysis primarily focuses on inferring the paramete...
research
06/23/2014

Exact fit of simple finite mixture models

How to forecast next year's portfolio-wide credit default rate based on ...

Please sign up or login with your details

Forgot password? Click here to reset