Pseudoinverse-free randomized extended block Kaczmarz for solving least squares

01/13/2020
by   Kui Du, et al.
0

Randomized iterative algorithms have recently been proposed to solve large-scale linear systems. In this paper, we present a simple randomized extended block Kaczmarz algorithm that exponentially converges in the mean square to the unique minimum ℓ_2-norm least squares solution of a given linear system of equations. The proposed algorithm is pseudoinverse-free and therefore different from the projection-based randomized double block Kaczmarz algorithm of Needell, Zhao, and Zouzias. We emphasize that our method works for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). Moreover, our approach can utilize efficient implementations on distributed computing units, yielding remarkable improvements in computational time. Numerical examples are given to show the efficiency of the new algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2022

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

The randomized Kaczmarz algorithm is one of the most popular approaches ...
research
10/27/2020

Randomized double and triple Kaczmarz for solving extended normal equations

The randomized Kaczmarz algorithm has received considerable attention re...
research
11/20/2020

Pseudoinverse-free randomized block iterative methods for consistent and inconsistent linear systems

Randomized iterative methods have attracted much attention in recent yea...
research
10/07/2022

On the extended randomized multiple row method for solving linear least-squares problems

The randomized row method is a popular representative of the iterative a...
research
12/31/2019

A doubly stochastic block Gauss-Seidel algorithm for solving linear equations

We propose a simple doubly stochastic block Gauss-Seidel algorithm for s...
research
10/02/2022

Error estimates of Kaczmarz and randomized Kaczmarz methods

The Kaczmarz method is an iterative projection scheme for solving con-si...
research
12/31/2022

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems

We investigate the randomized Kaczmarz method that adaptively updates th...

Please sign up or login with your details

Forgot password? Click here to reset