A Parameter Choice Rule for Tikhonov Regularization Based on Predictive Risk

12/30/2019
by   Federico Benvenuto, et al.
0

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise variance are known, and the parameter choice involves minimizing a function whose solution depends only on the signal-to-noise ratio. Moreover, when neither noise variance nor data norm is given, we propose an iterative algorithm which alternates between a minimization step of finding the regularization parameter and an estimation step of estimating signal-to-noise ratio. Simulation studies on both small- and large-scale datasets suggest that the approach can provide very accurate and stable regularized inverse solutions and, for small sized samples, it outperforms discrepancy principle, balancing principle, unbiased predictive risk estimator, L-curve method generalized cross validation, and quasi-optimality criterion, and achieves excellent stability hitherto unavailable.

READ FULL TEXT

page 17

page 18

research
07/12/2019

Adaptive Regularization Parameter Choice Rules for Large-Scale Problems

This paper derives a new class of adaptive regularization parameter choi...
research
05/13/2020

Inference on Achieved Signal Noise Ratio

We describe a procedure to perform approximate inference on the achieved...
research
09/03/2019

On the two-step estimation of the cross--power spectrum for dynamical inverse problems

We consider the problem of reconstructing the cross--power spectrum of a...
research
01/09/2020

Gaussian Approximation of Quantization Error for Estimation from Compressed Data

We consider the distributional connection between the lossy compressed r...
research
06/17/2020

Revisiting complexity and the bias-variance tradeoff

The recent success of high-dimensional models, such as deep neural netwo...
research
12/23/2021

Learning multiple regularization parameters for generalized Tikhonov regularization using multiple data sets without true data

During the inversion of discrete linear systems, noise in data can be am...
research
04/15/2018

Adaptivity for Regularized Kernel Methods by Lepskii's Principle

We address the problem of adaptivity in the framework of reproducing ke...

Please sign up or login with your details

Forgot password? Click here to reset