Log In Sign Up

How many samples are needed to reliably approximate the best linear estimator for a linear inverse problem?

by   Gernot Holler, et al.

The linear minimum mean squared error (LMMSE) estimator is the best linear estimator for a Bayesian linear inverse problem with respect to the mean squared error. It arises as the solution operator to a Tikhonov-type regularized inverse problem with a particular quadratic discrepancy term and a particular quadratic regularization operator. To be able to evaluate the LMMSE estimator, one must know the forward operator and the first two statistical moments of both the prior and the noise. If such knowledge is not available, one may approximate the LMMSE estimator based on given samples. In this work, it is investigated, in a finite-dimensional setting, how many samples are needed to reliably approximate the LMMSE estimator, in the sense that, with high probability, the mean squared error of the approximation is smaller than a given multiple of the mean squared error of the LMMSE estimator.


Optimal choice of k for k-nearest neighbor regression

The k-nearest neighbor algorithm (k-NN) is a widely used non-parametric ...

Learning to solve inverse problems using Wasserstein loss

We propose using the Wasserstein loss for training in inverse problems. ...

Learning the optimal regularizer for inverse problems

In this work, we consider the linear inverse problem y=Ax+ϵ, where A X→ ...

Model Mismatch Trade-offs in LMMSE Estimation

We consider a linear minimum mean squared error (LMMSE) estimation frame...

The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter

We derive a connection between performance of estimators the performance...

Multitaper estimation on arbitrary domains

Multitaper estimators have enjoyed significant success in providing spec...

Compressive Estimation of a Stochastic Process with Unknown Autocorrelation Function

In this paper, we study the prediction of a circularly symmetric zero-me...