Empirical Bayes Model Averaging with Influential Observations: Tuning Zellner's g Prior for Predictive Robustness

03/01/2021
by   Christopher M. Hans, et al.
0

We investigate the behavior of Bayesian model averaging (BMA) for the normal linear regression model in the presence of influential observations that contribute to model misfit, and propose remedies to attenuate the potential negative impacts of such observations on inference and prediction. The methodology is motivated by the view that well-behaved residuals and good predictive performance often go hand-in-hand. The study focuses on regression models that use variants on Zellner's g prior. By studying the impact of various forms of model misfit on BMA predictions in simple situations we identify prescriptive guidelines for "tuning" Zellner's g prior to obtain optimal predictions. The tuning of the prior distribution is obtained by considering theoretical properties that should be enjoyed by the optimal fits of the various models in the BMA ensemble. The methodology can be thought of as an "empirical Bayes" approach to modeling, as the data help to inform the specification of the prior in an attempt to attenuate the negative impact of influential cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2014

Population Empirical Bayes

Bayesian predictive inference analyzes a dataset to make predictions abo...
research
09/16/2022

Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm

Bayesian variable selection methods are powerful techniques for fitting ...
research
09/24/2017

Model Averaging and its Use in Economics

The method of model averaging has become an important tool to deal with ...
research
09/21/2021

An Empirical Bayes Robust Meta-Analytical-Predictive Prior to Adaptively Leverage External Data

We propose a novel empirical Bayes robust MAP (EB-rMAP) prior to adaptiv...
research
05/14/2014

Credal Model Averaging for classification: representing prior ignorance and expert opinions

Bayesian model averaging (BMA) is the state of the art approach for over...
research
01/29/2020

Quantifying Observed Prior Impact

We distinguish two questions (i) how much information does the prior con...

Please sign up or login with your details

Forgot password? Click here to reset