A Stabilized GMRES Method for Solving Underdetermined Least Squares Problems

by   Zeyu Liao, et al.

Consider using the right-preconditioned generalized minimal residual (AB-GMRES) method, which is an efficient method for solving underdetermined least squares problems. Morikuni (Ph.D. thesis, 2013) showed that for some inconsistent and ill-conditioned problems, the iterates of the AB-GMRES method may diverge. This is mainly because the Hessenberg matrix in the GMRES method becomes very ill-conditioned so that the backward substitution of the resulting triangular system becomes numerically unstable. We propose a stabilized GMRES based on solving the normal equations corresponding to the above triangular system using the standard Cholesky decomposition. This has the effect of shifting upwards the tiny singular values of the Hessenberg matrix which lead to an inaccurate solution. Thus, the process becomes numerically stable and the system becomes consistent, rendering better convergence and a more accurate solution. Numerical experiments show that the proposed method is robust and efficient for solving inconsistent and ill-conditioned underdetermined least squares problems. The method can be considered as a way of making the GMRES stable for highly ill-conditioned inconsistent problems.



There are no comments yet.


page 1


Vandermonde with Arnoldi

Vandermonde matrices are exponentially ill-conditioned, rendering the fa...

On least squares problems with certain Vandermonde--Khatri--Rao structure with applications to DMD

This paper proposes a new computational method for solving structured le...

Audio declipping performance enhancement via crossfading

Some audio declipping methods produce waveforms that do not fully respec...

On the sensitivity of singular and ill-Conditioned linear systems

Solving a singular linear system for an individual vector solution is an...

Well-Conditioned Methods for Ill-Conditioned Systems: Linear Regression with Semi-Random Noise

Classical iterative algorithms for linear system solving and regression ...

The AZ algorithm for least squares systems with a known incomplete generalized inverse

We introduce an algorithm for the least squares solution of a rectangula...

HIFIR: Hybrid Incomplete Factorization with Iterative Refinement for Preconditioning Ill-conditioned and Singular Systems

We introduce a software package called HIFIR for preconditioning sparse,...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.