Residual QPAS subspace (ResQPASS) algorithm for bounded-variable least squares (BVLS) with superlinear Krylov convergence

02/27/2023
by   Bas Symoens, et al.
0

This paper presents the Residual QPAS Subspace method (ResQPASS) method that solves large-scale least-squares problem with bound constraints on the variables. The problem is solved by creating a series of small problems with increasing size by projecting on the basis residuals. Each projected problem is solved by the QPAS method that is warm-started with a working set and the solution of the previous problem. The method coincides with conjugate gradients (CG) applied to the normal equations when none of the constraints is active. When only a few constraints are active the method converges, after a few initial iterations, as the CG method. We develop a convergence theory that links the convergence with Krylov subspaces. We also present an efficient implementation where the matrix factorizations using QR are updated over the inner and outer iterations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/27/2021

Krylov-Simplex method that minimizes the residual in ℓ_1-norm or ℓ_∞-norm

The paper presents two variants of a Krylov-Simplex iterative method tha...
research
06/24/2021

Solving large linear least squares with linear equality constraints

We consider the problem of efficiently solving large-scale linear least ...
research
08/11/2020

On inner iterations of the joint bidiagonalization based algorithms for solving large scale linear discrete ill-posed problems

The joint bidiagonalization process of a large matrix pair A,L can be us...
research
01/22/2013

Properties of the Least Squares Temporal Difference learning algorithm

This paper presents four different ways of looking at the well-known Lea...
research
11/23/2022

Filtering for Anderson acceleration

This work introduces, analyzes and demonstrates an efficient and theoret...
research
07/11/2023

Solving Minimal Residual Methods in W^-1,p with large Exponents p

We introduce a numerical scheme that approximates solutions to linear PD...
research
07/13/2019

Minimal Sample Subspace Learning: Theory and Algorithms

Subspace segmentation or subspace learning is a challenging and complica...

Please sign up or login with your details

Forgot password? Click here to reset