Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inference

04/21/2023
by   Florentin Coeurdoux, et al.
0

This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the alternating direction method of multipliers (ADMM). It divides the challenging task of posterior sampling into two simpler sampling problems. The first problem depends on the likelihood function, while the second is interpreted as a Bayesian denoising problem that can be readily carried out by a deep generative model. Specifically, for an illustrative purpose, the proposed method is implemented in this paper using state-of-the-art diffusion-based generative models. Akin to its deterministic PnP-based counterparts, the proposed method exhibits the great advantage of not requiring an explicit choice of the prior distribution, which is rather encoded into a pre-trained generative model. However, unlike optimization methods (e.g., PnP-ADMM) which generally provide only point estimates, the proposed approach allows conventional Bayesian estimators to be accompanied by confidence intervals at a reasonable additional computational cost. Experiments on commonly studied image processing problems illustrate the efficiency of the proposed sampling strategy. Its performance is compared to recent state-of-the-art optimization and sampling methods.

READ FULL TEXT

page 10

page 11

research
04/16/2018

Split-and-augmented Gibbs sampler - Application to large-scale inference problems

Recently, a new class of Markov chain Monte Carlo (MCMC) algorithms took...
research
10/05/2022

A distributed Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems

Sampling-based algorithms are classical approaches to perform Bayesian i...
research
05/23/2019

Efficient MCMC Sampling with Dimension-Free Convergence Rate using ADMM-type Splitting

Performing exact Bayesian inference for complex models is intractable. M...
research
02/22/2023

VI-DGP: A variational inference method with deep generative prior for solving high-dimensional inverse problems

Solving high-dimensional Bayesian inverse problems (BIPs) with the varia...
research
06/13/2017

Generative Models for Learning from Crowds

In this paper, we propose generative probabilistic models for label aggr...
research
06/12/2023

Generative Plug and Play: Posterior Sampling for Inverse Problems

Over the past decade, Plug-and-Play (PnP) has become a popular method fo...
research
07/30/2020

Rewriting a Deep Generative Model

A deep generative model such as a GAN learns to model a rich set of sema...

Please sign up or login with your details

Forgot password? Click here to reset