On the Stability of General Bayesian Inference

01/31/2023
by   Jack Jewson, et al.
0

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, the decision-maker may elicit useful broad structural judgements but a level of interpolation is required to arrive at a likelihood model. One model, often a computationally convenient canonical form, is chosen, when many alternatives would have been equally consistent with the elicited judgements. Equally, observational datasets often contain unforeseen heterogeneities and recording errors. Acknowledging such imprecisions, a faithful Bayesian analysis should be stable across reasonable equivalence classes for these inputs. We show that traditional Bayesian updating provides stability across a very strict class of likelihood models and DGPs, while a generalised Bayesian alternative using the beta-divergence loss function is shown to be stable across practical and interpretable neighbourhoods. We illustrate this in linear regression, binary classification, and mixture modelling examples, showing that stable updating does not compromise the ability to learn about the DGP. These stability results provide a compelling justification for using generalised Bayes to facilitate inference under simplified canonical models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/01/2021

General Bayesian L^2 calibration of mathematical models

A general Bayesian method for L^2 calibration of a mathematical model is...
research
09/22/2017

Generalized Bayesian Updating and the Loss-Likelihood Bootstrap

In this paper, we revisit the weighted likelihood bootstrap and show tha...
research
12/15/2019

Using bagged posteriors for robust inference and model criticism

Standard Bayesian inference is known to be sensitive to model misspecifi...
research
12/12/2019

Diagnosing model misspecification and performing generalized Bayes' updates via probabilistic classifiers

Model misspecification is a long-standing enigma of the Bayesian inferen...
research
06/06/2018

Doubly Robust Bayesian Inference for Non-Stationary Streaming Data with β-Divergences

We present the very first robust Bayesian Online Changepoint Detection a...
research
07/08/2020

Generalised Bayes Updates with f-divergences through Probabilistic Classifiers

A stream of algorithmic advances has steadily increased the popularity o...
research
03/26/2022

Influential Observations in Bayesian Regression Tree Models

BCART (Bayesian Classification and Regression Trees) and BART (Bayesian ...

Please sign up or login with your details

Forgot password? Click here to reset