On the Polyak momentum variants of the greedy deterministic single and multiple row-action methods

12/13/2022
by   Nian-Ci Wu, et al.
0

For solving a consistent system of linear equations, the classical row-action (also known as Kaczmarz) method is a simple while really effective iteration solver. Based on the greedy index selection strategy and Polyak's heavy-ball momentum acceleration technique, we propose two deterministic row-action methods and establish the corresponding convergence theory. We show that our algorithm can linearly converge to a least-squares solution with minimum Euclidean norm. Several numerical studies have been presented to corroborate our theoretical findings. Real-world applications, such as data fitting in computer-aided geometry design, are also presented for illustrative purposes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2022

On the extended randomized multiple row method for solving linear least-squares problems

The randomized row method is a popular representative of the iterative a...
research
01/30/2023

On the relaxed greedy randomized Kaczmarz methods with momentum acceleration for solving matrix equation AXB=C

With the growth of data, it is more important than ever to develop an ef...
research
12/07/2019

Greed Works: An Improved Analysis of Sampling Kaczmarz-Motkzin

Stochastic iterative algorithms have gained recent interest in machine l...
research
07/05/2023

The linear convergence of the greedy randomized Kaczmarz method is deterministic

To improve the convergence property of the randomized Kaczmarz (RK) meth...
research
04/10/2021

Convergence of Adaptive, Randomized, Iterative Linear Solvers

Deterministic and randomized, row-action and column-action linear solver...
research
03/29/2022

On the relaxed greedy deterministic row and column iterative methods

For solving the large-scale linear system by iteration methods, we utili...
research
12/17/2019

Sampled Limited Memory Methods for Massive Linear Inverse Problems

In many modern imaging applications the desire to reconstruct high resol...

Please sign up or login with your details

Forgot password? Click here to reset