Bayesian Inverse Problems with Heterogeneous Variance

10/15/2019
by   Natalia Bochkina, et al.
0

We consider inverse problems in Hilbert spaces contaminated by Gaussian noise, and use a Bayesian approach to find its regularised smooth solution. We consider the so called conjugate diagonal setting where the covariance operators of the noise and of the prior are diagnolisable in the orthogonal bases associated with the forward operator of the inverse problem. Firstly, we derive the minimax rate of convergence in such problems with known covariance operator of the noise, showing that in the case of heterogeneous variance the ill posed inverse problem can become self regularised in some cases when the eigenvalues of the variance operator decay to zero, achieving parametric rate of convergence; as far as we are aware, this is a striking novel result that have not been observed before in nonparametric problems. Secondly, we give a general expression of the rate of contraction of the posterior distribution in case of known noise covariance operator in case the noise level is small, for a given prior distribution. We also investigate when this contraction rate coincides with the optimal rate in the minimax sense which is typically used as a benchmark for studying the posterior contraction rates. We apply our results to known variance operators with polynomially decreasing or increasing eigenvalues as an example. We also discuss when the plug in estimator of the eigenvalues of the covariance operator of the noise does not affect the rate of the contraction of the posterior distribution of the signal. We show that plugging in the maximum marginal likelihood estimator of the prior scaling parameter leads to the optimal posterior contraction rate, adaptively. Effect of the choice of the prior parameters on the contraction in such models is illustrated on simulated data with Volterra operator.

READ FULL TEXT
research
10/04/2018

Posterior contraction for empirical Bayesian approach to inverse problems under non-diagonal assumption

We investigate an empirical Bayesian nonparametric approach to a family ...
research
01/29/2018

Bayesian inverse problems with non-commuting operators

The Bayesian approach to ill-posed operator equations in Hilbert space r...
research
12/29/2022

A Data-Adaptive Prior for Bayesian Learning of Kernels in Operators

Kernels are efficient in representing nonlocal dependence and they are w...
research
05/11/2018

Rate optimal estimation of quadratic functionals in inverse problems with partially unknown operator and application to testing problems

We consider the estimation of quadratic functionals in a Gaussian sequen...
research
08/27/2021

Convergence Rates for Learning Linear Operators from Noisy Data

We study the Bayesian inverse problem of learning a linear operator on a...
research
01/11/2023

On Bayes risk of the posterior mean in linear inverse problems

We recall some basics regarding the concept of Bayes risk in the context...
research
11/15/2019

Akaike's Bayesian information criterion (ABIC) or not ABIC for geophysical inversion

Akaike's Bayesian information criterion (ABIC) has been widely used in g...

Please sign up or login with your details

Forgot password? Click here to reset