Robust Generalised Bayesian Inference for Intractable Likelihoods

by   Takuo Matsubara, et al.

Generalised Bayesian inference updates prior beliefs using a loss function, rather than a likelihood, and can therefore be used to confer robustness against possible misspecification of the likelihood. Here we consider generalised Bayesian inference with a Stein discrepancy as a loss function, motivated by applications in which the likelihood contains an intractable normalisation constant. In this context, the Stein discrepancy circumvents evaluation of the normalisation constant and produces generalised posteriors that are either closed form or accessible using standard Markov chain Monte Carlo. On a theoretical level, we show consistency, asymptotic normality, and bias-robustness of the generalised posterior, highlighting how these properties are impacted by the choice of Stein discrepancy. Then, we provide numerical experiments on a range of intractable distributions, including applications to kernel-based exponential family models and non-Gaussian graphical models.



There are no comments yet.


page 1

page 2

page 3

page 4


Diagnostics for Monte Carlo Algorithms for Models with Intractable Normalizing Functions

Models with intractable normalizing functions have numerous applications...

Robust Bayesian Inference for Simulator-based Models via the MMD Posterior Bootstrap

Simulator-based models are models for which the likelihood is intractabl...

Fast spatial inference in the homogeneous Ising model

The Ising model is important in statistical modeling and inference in ma...

On the Occasional Exactness of the Distributional Transform Approximation for Direct Gaussian Copula Models with Discrete Margins

The direct Gaussian copula model with discrete marginal distributions is...

Generalised Bayes Updates with f-divergences through Probabilistic Classifiers

A stream of algorithmic advances has steadily increased the popularity o...

A closed-form approach to Bayesian inference in tree-structured graphical models

We consider the inference of the structure of an undirected graphical mo...

Generalized Bayesian Updating and the Loss-Likelihood Bootstrap

In this paper, we revisit the weighted likelihood bootstrap and show tha...

Code Repositories


Experiment Code for "Robust Generalised Bayesian Inference for Intractable Likelihoods" (

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.