A generalized AIC for models with singularities and boundaries

11/08/2022
by   Jonathan D. Mitchell, et al.
0

The Akaike information criterion (AIC) is a common tool for model selection. It is frequently used in violation of regularity conditions at parameter space singularities and boundaries. The expected AIC is generally not asymptotically equivalent to its target at singularities and boundaries, and convergence to the target at nearby parameter points may be slow. We develop a generalized AIC for candidate models with or without singularities and boundaries. We show that the expectation of this generalized form converges everywhere in the parameter space, and its convergence can be faster than that of the AIC. We illustrate the generalized AIC on example models from phylogenomics, showing that it can outperform the AIC and gives rise to an interpolated effective number of model parameters, which can differ substantially from the number of parameters near singularities and boundaries. We outline methods for estimating the often unknown generating parameter and bias correction term of the generalized AIC.

READ FULL TEXT
research
04/20/2021

Constrained Bayesian Hierarchical Models for Gaussian Data: A Model Selection Criterion Approach

Consider the setting where there are B>1 candidate statistical models, a...
research
06/17/2022

On the Influence of Enforcing Model Identifiability on Learning dynamics of Gaussian Mixture Models

A common way to learn and analyze statistical models is to consider oper...
research
03/09/2021

Asymptotic posterior normality of the generalized extreme value distribution

The univariate generalized extreme value (GEV) distribution is the most ...
research
10/28/2022

Bayesian Model Selection of Lithium-Ion Battery Models via Bayesian Quadrature

A wide variety of battery models are available, and it is not always obv...
research
02/03/2021

Microscopic Patterns in the 2D Phase-Field-Crystal Model

Using the recently developed theory of rigorously validated numerics, we...
research
10/19/2019

Efficient Emulation of Computer Models Utilising Multiple Known Boundaries of Differing Dimensions

Emulation has been successfully applied across a wide variety of scienti...
research
06/24/2020

Machine learning the real discriminant locus

Parameterized systems of polynomial equations arise in many applications...

Please sign up or login with your details

Forgot password? Click here to reset