Proximal MCMC for Bayesian Inference of Constrained and Regularized Estimation

05/15/2022
by   Xinkai Zhou, et al.
0

This paper advocates proximal Markov Chain Monte Carlo (ProxMCMC) as a flexible and general Bayesian inference framework for constrained or regularized estimation. Originally introduced in the Bayesian imaging literature, ProxMCMC employs the Moreau-Yosida envelope for a smooth approximation of the total-variation regularization term, fixes nuisance and regularization strength parameters as constants, and relies on the Langevin algorithm for the posterior sampling. We extend ProxMCMC to the full Bayesian framework with modeling and data adaptive estimation of all parameters including the regularization strength parameter. More efficient sampling algorithms such as the Hamiltonian Monte Carlo are employed to scale ProxMCMC to high-dimensional problems. Analogous to the proximal algorithms in optimization, ProxMCMC offers a versatile and modularized procedure for the inference of constrained and non-smooth problems. The power of ProxMCMC is illustrated on various statistical estimation and machine learning tasks. The inference in these problems is traditionally considered difficult from both frequentist and Bayesian perspectives.

READ FULL TEXT
research
01/01/2022

Bayesian Trend Filtering via Proximal Markov Chain Monte Carlo

Proximal Markov Chain Monte Carlo is a novel construct that lies at the ...
research
06/07/2021

High-dimensional Bayesian model selection by proximal nested sampling

Imaging methods often rely on Bayesian statistical inference strategies ...
research
08/05/2020

Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian Processes

We present a Bayesian approach to identify optimal transformations that ...
research
10/21/2022

Distance-to-Set Priors and Constrained Bayesian Inference

Constrained learning is prevalent in many statistical tasks. Recent work...
research
10/04/2020

High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm

Efficient sampling from a high-dimensional Gaussian distribution is an o...
research
11/02/2019

Bayesian inference for dynamic vine copulas in higher dimensions

We propose a class of dynamic vine copula models. This is an extension o...
research
03/16/2021

Gradient-Based Markov Chain Monte Carlo for Bayesian Inference With Non-Differentiable Priors

The use of non-differentiable priors in Bayesian statistics has become i...

Please sign up or login with your details

Forgot password? Click here to reset