A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

08/12/2023
by   Haibo Li, et al.
0

Tikhonov regularization is a widely used technique in solving inverse problems that can enforce prior properties on the desired solution. In this paper, we propose a Krylov subspace based iterative method for solving linear inverse problems with general-form Tikhonov regularization term x^TMx, where M is a positive semi-definite matrix. An iterative process called the preconditioned Golub-Kahan bidiagonalization (pGKB) is designed, which implicitly utilizes a proper preconditioner to generate a series of solution subspaces with desirable properties encoded by the regularizer x^TMx. Based on the pGKB process, we propose an iterative regularization algorithm via projecting the original problem onto small dimensional solution subspaces. We analyze regularization effect of this algorithm, including the incorporation of prior properties of the desired solution into the solution subspace and the semi-convergence behavior of regularized solution. To overcome instabilities caused by semi-convergence, we further propose two pGKB based hybrid regularization algorithms. All the proposed algorithms are tested on both small-scale and large-scale linear inverse problems. Numerical results demonstrate that these iterative algorithms exhibit excellent performance, outperforming other state-of-the-art algorithms in some cases.

READ FULL TEXT

page 21

page 22

research
05/15/2021

Computational methods for large-scale inverse problems: a survey on hybrid projection methods

This paper surveys an important class of methods that combine iterative ...
research
01/10/2023

First-projection-then-regularization hybrid algorithms for large-scale general-form regularization

The paper presents first-projection-then-regularization hybrid algorithm...
research
01/13/2019

Neumann Networks for Inverse Problems in Imaging

Many challenging image processing tasks can be described by an ill-posed...
research
05/29/2021

An ℓ_p Variable Projection Method for Large-Scale Separable Nonlinear Inverse Problems

The variable projection (VarPro) method is an efficient method to solve ...
research
01/03/2017

Robust method for finding sparse solutions to linear inverse problems using an L2 regularization

We analyzed the performance of a biologically inspired algorithm called ...
research
11/03/2022

Learning Control by Iterative Inversion

We formulate learning for control as an inverse problem – inverting a dy...
research
10/07/2019

All-at-once versus reduced iterative methods for time dependent inverse problems

In this paper we investigate all-at-once versus reduced regularization o...

Please sign up or login with your details

Forgot password? Click here to reset