Posterior Averaging Information Criterion

by   Shouhao Zhou, et al.

We propose a new model selection method, the posterior averaging information criterion, for Bayesian model assessment from a predictive perspective. The theoretical foundation is built on the Kullback-Leibler divergence to quantify the similarity between the proposed candidate model and the underlying true model. From a Bayesian perspective, our method evaluates the candidate models over the entire posterior distribution in terms of predicting a future independent observation. Without assuming that the true distribution is contained in the candidate models, the new criterion is developed by correcting the asymptotic bias of the posterior mean of the log-likelihood against its expected log-likelihood. It can be generally applied even for Bayesian models with degenerate non-informative prior. The simulation in both normal and binomial settings demonstrates decent small sample performance.



There are no comments yet.


page 1

page 2

page 3

page 4


Regression model selection via log-likelihood ratio and constrained minimum criterion

Although the log-likelihood is widely used in model selection, the log-l...

Constrained Bayesian Hierarchical Models for Gaussian Data: A Model Selection Criterion Approach

Consider the setting where there are B>1 candidate statistical models, a...

Focused Bayesian Prediction

We propose a new method for conducting Bayesian prediction that delivers...

Schwartz type model selection for ergodic stochastic differential equation models

We study the construction of the theoretical foundation of model compari...

Data augmentation in Bayesian neural networks and the cold posterior effect

Data augmentation is a highly effective approach for improving performan...

Exact log-likelihood for clustering parameterised models and normally distributed data

Taking a model with equal means in each cluster, the log-likelihood for ...

Probably the Best Itemsets

One of the main current challenges in itemset mining is to discover a sm...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.