Efficient sampling of non log-concave posterior distributions with mixture of noises

11/23/2022
by   Pierre Palud, et al.
0

This paper focuses on a challenging class of inverse problems that is often encountered in applications. The forward model is a complex non-linear black-box, potentially non-injective, whose outputs cover multiple decades in amplitude. Observations are supposed to be simultaneously damaged by additive and multiplicative noises and censorship. As needed in many applications, the aim of this work is to provide uncertainty quantification on top of parameter estimates. The resulting log-likelihood is intractable and potentially non-log-concave. An adapted Bayesian approach is proposed to provide credibility intervals along with point estimates. An MCMC algorithm is proposed to deal with the multimodal posterior distribution, even in a situation where there is no global Lipschitz constant (or it is very large). It combines two kernels, namely an improved version of (Preconditioned Metropolis Adjusted Langevin) PMALA and a Multiple Try Metropolis (MTM) kernel. Whenever smooth, its gradient admits a Lipschitz constant too large to be exploited in the inference process. This sampler addresses all the challenges induced by the complex form of the likelihood. The proposed method is illustrated on classical test multimodal distributions as well as on a challenging and realistic inverse problem in astronomy.

READ FULL TEXT

page 8

page 10

research
05/17/2021

On log-concave approximations of high-dimensional posterior measures and stability properties in non-linear inverse problems

The problem of efficiently generating random samples from high-dimension...
research
06/17/2019

On the Locally Lipschitz Robustness of Bayesian Inverse Problems

In this note we consider the robustness of posterior measures occuring i...
research
09/03/2019

A Diffusion Process Perspective on Posterior Contraction Rates for Parameters

We show that diffusion processes can be exploited to study the posterior...
research
12/23/2022

Cost free hyper-parameter selection/averaging for Bayesian inverse problems with vanilla and Rao-Blackwellized SMC Samplers

In Bayesian inverse problems, one aims at characterizing the posterior d...
research
11/02/2022

Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

Bayesian methods of sampling from a posterior distribution are becoming ...
research
06/13/2022

On the Computational Complexity of Metropolis-Adjusted Langevin Algorithms for Bayesian Posterior Sampling

In this paper, we study the computational complexity of sampling from a ...
research
08/16/2021

Multimodal Information Gain in Bayesian Design of Experiments

One of the well-known challenges in optimal experimental design is how t...

Please sign up or login with your details

Forgot password? Click here to reset