Preconditioning Kaczmarz method by sketching

03/05/2019
by   Alexandr Katrutsa, et al.
0

We propose a new method for preconditioning Kaczmarz method by sketching. Kaczmarz method is a stochastic method for solving overdetermined linear systems based on a sampling of matrix rows. The standard approach to speed up convergence of iterative methods is using preconditioner. As we show the best possible preconditioner for this method can be constructed from QR decomposition of the system matrix, but the complexity of this procedure is too high. Therefore, to reduce this complexity, we use random sketching and compare it with the Kaczmarz method without preconditioning. The developed method is applicable for different modifications of classical Kaczmarz method that were proposed recently. We provide numerical experiments to show the performance of the developed methods on solving both random and real overdetermined linear systems.

READ FULL TEXT

page 7

page 9

research
06/06/2023

A sketch-and-project method for solving the matrix equation AXB = C

In this paper, based on an optimization problem, a sketch-and-project me...
research
11/28/2019

Sketching for Motzkin's Iterative Method for Linear Systems

Projection-based iterative methods for solving large over-determined lin...
research
07/30/2019

Revisiting Performance of BiCGStab Methods for Solving Systems with Multiple Right-Hand Sides

The paper discusses the efficiency of the classical BiCGStab method and ...
research
02/13/2021

A New family of methods for solving delay differential equations

In the present paper, we introduce a new family of θ-methods for solving...
research
06/24/2021

Solving large linear least squares with linear equality constraints

We consider the problem of efficiently solving large-scale linear least ...
research
10/07/2019

An Algorithmic Inference Approach to Learn Copulas

We introduce a new method for estimating the parameter of the bivariate ...
research
08/31/2021

Sensitivity Approximation by the Peano-Baker Series

In this paper we develop a new method for numerically approximating sens...

Please sign up or login with your details

Forgot password? Click here to reset