Duality between Approximate Bayesian Methods and Prior Robustness

04/02/2020
by   Chaitanya Joshi, et al.
0

In this paper we show that there is a link between approximate Bayesian methods and prior robustness. We show that what is typically recognized as an approximation to the likelihood, either due to the simulated data as in the Approximate Bayesian Computation (ABC) methods or due to the functional approximation to the likelihood, can instead also be viewed upon as an implicit exercise in prior robustness. We first define two new classes of priors for the cases where the sufficient statistics is available, establish their mathematical properties and show, for a simple illustrative example, that these classes of priors can also be used to obtain the posterior distribution that would be obtained by implementing ABC. We then generalize and define two further classes of priors that are applicable in very general scenarios; one where the sufficient statistics is not available and another where the likelihood is approximated using a functional approximation. We then discuss the interpretation and elicitation aspects of the classes proposed here as well as their potential applications and possible computational benefits. These classes establish the duality between approximate Bayesian inference and prior robustness for a wide category of Bayesian inference methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2022

Weakly informative priors and prior-data conflict checking for likelihood-free inference

Bayesian likelihood-free inference, which is used to perform Bayesian in...
research
10/28/2019

Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset

This paper tackles the challenge presented by small-data to the task of ...
research
05/15/2019

Measuring Bayesian Robustness Using Rényi's Divergence and Relationship with Prior-Data Conflict

This paper deals with measuring the Bayesian robustness of classes of co...
research
06/27/2022

Approximation of bayesian Hawkes process models with Inlabru

Hawkes process are very popular mathematical tools for modelling phenome...
research
10/05/2015

Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family

In this paper, a Bayesian inference technique based on Taylor series app...
research
02/09/2023

Practical Guidance for Bayesian Inference in Astronomy

In the last two decades, Bayesian inference has become commonplace in as...
research
10/15/2018

Evaluating Sensitivity to the Stick Breaking Prior in Bayesian Nonparametrics

A central question in many probabilistic clustering problems is how many...

Please sign up or login with your details

Forgot password? Click here to reset