Sparse Bayesian Inference with Regularized Gaussian Distributions

02/14/2023
by   Jasper Marijn Everink, et al.
0

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization. Although the solutions to many such regularized inverse problems can be considered as points of maximum probability of well-chosen posterior distributions, samples from these distributions are generally not sparse. In this paper, we present a framework for implicitly defining a probability distribution that combines the effects of sparsity imposing regularization with Gaussian distributions. Unlike continuous distributions, these implicit distributions can assign positive probability to sparse vectors. We study these regularized distributions for various regularization functions including total variation regularization and piecewise linear convex functions. We apply the developed theory to uncertainty quantification for Bayesian linear inverse problems and derive a Gibbs sampler for a Bayesian hierarchical model. To illustrate the difference between our sparsity-inducing framework and continuous distributions, we apply our framework to small-scale deblurring and computed tomography examples.

READ FULL TEXT
research
10/13/2022

Probabilistic Approach to Parameteric Inverse Problems Using Gibbs Posteriors

We propose a general framework for obtaining probabilistic solutions to ...
research
09/26/2022

Bayesian Inference with Projected Densities

Constraints are a natural choice for prior information in Bayesian infer...
research
02/05/2018

Continuous-Domain Solutions of Linear Inverse Problems with Tikhonov vs. Generalized TV Regularization

We consider linear inverse problems that are formulated in the continuou...
research
07/07/2014

Low Complexity Regularization of Linear Inverse Problems

Inverse problems and regularization theory is a central theme in contemp...
research
06/27/2023

Sparse wavelet-based solutions for the M/EEG inverse problem

This paper is concerned with variational and Bayesian approaches to neur...
research
12/10/2021

Solving linear Bayesian inverse problems using a fractional total variation-Gaussian (FTG) prior and transport map

The Bayesian inference is widely used in many scientific and engineering...
research
04/29/2020

A novel two-point gradient method for Regularization of inverse problems in Banach spaces

In this paper, we introduce a novel two-point gradient method for solvin...

Please sign up or login with your details

Forgot password? Click here to reset