Robust Generalised Bayesian Inference for Intractable Likelihoods

04/15/2021
by   Takuo Matsubara, et al.
9

Generalised Bayesian inference updates prior beliefs using a loss function, rather than a likelihood, and can therefore be used to confer robustness against possible misspecification of the likelihood. Here we consider generalised Bayesian inference with a Stein discrepancy as a loss function, motivated by applications in which the likelihood contains an intractable normalisation constant. In this context, the Stein discrepancy circumvents evaluation of the normalisation constant and produces generalised posteriors that are either closed form or accessible using standard Markov chain Monte Carlo. On a theoretical level, we show consistency, asymptotic normality, and bias-robustness of the generalised posterior, highlighting how these properties are impacted by the choice of Stein discrepancy. Then, we provide numerical experiments on a range of intractable distributions, including applications to kernel-based exponential family models and non-Gaussian graphical models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

09/10/2021

Diagnostics for Monte Carlo Algorithms for Models with Intractable Normalizing Functions

Models with intractable normalizing functions have numerous applications...
02/09/2022

Robust Bayesian Inference for Simulator-based Models via the MMD Posterior Bootstrap

Simulator-based models are models for which the likelihood is intractabl...
12/06/2017

Fast spatial inference in the homogeneous Ising model

The Ising model is important in statistical modeling and inference in ma...
03/05/2021

On the Occasional Exactness of the Distributional Transform Approximation for Direct Gaussian Copula Models with Discrete Margins

The direct Gaussian copula model with discrete marginal distributions is...
07/08/2020

Generalised Bayes Updates with f-divergences through Probabilistic Classifiers

A stream of algorithmic advances has steadily increased the popularity o...
04/10/2015

A closed-form approach to Bayesian inference in tree-structured graphical models

We consider the inference of the structure of an undirected graphical mo...
09/22/2017

Generalized Bayesian Updating and the Loss-Likelihood Bootstrap

In this paper, we revisit the weighted likelihood bootstrap and show tha...

Code Repositories

KSD-Bayes

Experiment Code for "Robust Generalised Bayesian Inference for Intractable Likelihoods" (https://arxiv.org/abs/2104.07359)


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.