Three Approaches to Probability Model Selection

02/27/2013
by   William B. Poland, et al.
0

This paper compares three approaches to the problem of selecting among probability models to fit data (1) use of statistical criteria such as Akaike's information criterion and Schwarz's "Bayesian information criterion," (2) maximization of the posterior probability of the model, and (3) maximization of an effectiveness ratio? trading off accuracy and computational cost. The unifying characteristic of the approaches is that all can be viewed as maximizing a penalized likelihood function. The second approach with suitable prior distributions has been shown to reduce to the first. This paper shows that the third approach reduces to the second for a particular form of the effectiveness ratio, and illustrates all three approaches with the problem of selecting the number of components in a mixture of Gaussian distributions. Unlike the first two approaches, the third can be used even when the candidate models are chosen for computational efficiency, without regard to physical interpretation, so that the likelihood and the prior distribution over models cannot be interpreted literally. As the most general and computationally oriented of the approaches, it is especially useful for artificial intelligence applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
11/21/2019

Multi-model mimicry for model selection according to generalised goodness-of-fit criteria

Selecting between candidate models is at the core of statistical practic...
research
06/30/2015

On the Equivalence of Factorized Information Criterion Regularization and the Chinese Restaurant Process Prior

Factorized Information Criterion (FIC) is a recently developed informati...
research
08/19/2022

Consistent Bayesian Information Criterion Based on a Mixture Prior for Possibly High-Dimensional Multivariate Linear Regression Models

In the problem of selecting variables in a multivariate linear regressio...
research
03/09/2020

Information criteria for inhomogeneous spatial point processes

The theoretical foundation for a number of model selection criteria is e...
research
07/26/2023

Statistical complexity as a criterion for the useful signal detection problem

Three variants of the statistical complexity function, which is used as ...
research
08/08/2023

Are Information criteria good enough to choose the right the number of regimes in Hidden Markov Models?

Selecting the number of regimes in Hidden Markov models is an important ...
research
05/07/2001

Joint and conditional estimation of tagging and parsing models

This paper compares two different ways of estimating statistical languag...

Please sign up or login with your details

Forgot password? Click here to reset