Splitting-based randomized iterative methods for solving indefinite least squares problem

03/29/2022
by   Yanjun Zhang, et al.
0

The indefinite least squares (ILS) problem is a generalization of the famous linear least squares problem. It minimizes an indefinite quadratic form with respect to a signature matrix. For this problem, we first propose an impressively simple and effective splitting (SP) method according to its own structure and prove that it converges 'unconditionally' for any initial value. Further, to avoid implementing some matrix multiplications and calculating the inverse of large matrix and considering the acceleration and efficiency of the randomized strategy, we develop two randomized iterative methods on the basis of the SP method as well as the randomized Kaczmarz, Gauss-Seidel and coordinate descent methods, and describe their convergence properties. Numerical results show that our three methods all have quite decent performance in both computing time and iteration numbers compared with the latest iterative method of the ILS problem, and also demonstrate that the two randomized methods indeed yield significant acceleration in term of computing time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2020

A novel greedy Gauss-Seidel method for solving large linear least squares problem

We present a novel greedy Gauss-Seidel method for solving large linear l...
research
01/25/2022

Generalized Gearhart-Koshy acceleration for the Kaczmarz method

The Kaczmarz method is an iterative numerical method for solving large a...
research
11/23/2022

Filtering for Anderson acceleration

This work introduces, analyzes and demonstrates an efficient and theoret...
research
06/01/2021

Gauss-Seidel Method with Oblique Direction

In this paper, a Gauss-Seidel method with oblique direction (GSO) is pro...
research
06/02/2023

Linearly convergent adjoint free solution of least squares problems by random descent

We consider the problem of solving linear least squares problems in a fr...
research
11/13/2014

A Randomized Algorithm for CCA

We present RandomizedCCA, a randomized algorithm for computing canonical...
research
06/02/2017

Understanding the Learned Iterative Soft Thresholding Algorithm with matrix factorization

Sparse coding is a core building block in many data analysis and machine...

Please sign up or login with your details

Forgot password? Click here to reset