Posterior Averaging Information Criterion

09/19/2020
by   Shouhao Zhou, et al.
0

We propose a new model selection method, the posterior averaging information criterion, for Bayesian model assessment from a predictive perspective. The theoretical foundation is built on the Kullback-Leibler divergence to quantify the similarity between the proposed candidate model and the underlying true model. From a Bayesian perspective, our method evaluates the candidate models over the entire posterior distribution in terms of predicting a future independent observation. Without assuming that the true distribution is contained in the candidate models, the new criterion is developed by correcting the asymptotic bias of the posterior mean of the log-likelihood against its expected log-likelihood. It can be generally applied even for Bayesian models with degenerate non-informative prior. The simulation in both normal and binomial settings demonstrates decent small sample performance.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

07/18/2021

Regression model selection via log-likelihood ratio and constrained minimum criterion

Although the log-likelihood is widely used in model selection, the log-l...
04/20/2021

Constrained Bayesian Hierarchical Models for Gaussian Data: A Model Selection Criterion Approach

Consider the setting where there are B>1 candidate statistical models, a...
12/29/2019

Focused Bayesian Prediction

We propose a new method for conducting Bayesian prediction that delivers...
04/28/2019

Schwartz type model selection for ergodic stochastic differential equation models

We study the construction of the theoretical foundation of model compari...
06/10/2021

Data augmentation in Bayesian neural networks and the cold posterior effect

Data augmentation is a highly effective approach for improving performan...
08/10/2020

Exact log-likelihood for clustering parameterised models and normally distributed data

Taking a model with equal means in each cluster, the log-likelihood for ...
02/07/2019

Probably the Best Itemsets

One of the main current challenges in itemset mining is to discover a sm...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.