Sparse Sampling Kaczmarz-Motzkin Method with Linear Convergence

01/13/2021
by   Ziyang Yuan, et al.
0

The randomized sparse Kaczmarz method was recently proposed to recover sparse solutions of linear systems. In this work, we introduce a greedy variant of the randomized sparse Kaczmarz method by employing the sampling Kaczmarz-Motzkin method, and prove its linear convergence in expectation with respect to the Bregman distance in the noiseless and noisy cases. This greedy variant can be viewed as a unification of the sampling Kaczmarz-Motzkin method and the randomized sparse Kaczmarz method, and hence inherits the merits of these two methods. Numerically, we report a couple of experimental results to demonstrate its superiority

READ FULL TEXT

page 12

page 13

page 16

research
06/12/2023

A Weighted Randomized Sparse Kaczmarz Method for Solving Linear Systems

The randomized sparse Kaczmarz method, designed for seeking the sparse s...
research
09/13/2022

Greedy randomized sampling nonlinear Kaczmarz methods

The nonlinear Kaczmarz method was recently proposed to solve the system ...
research
03/21/2022

Faster Randomized Block Sparse Kaczmarz by Averaging

The standard randomized sparse Kaczmarz (RSK) method is an algorithm to ...
research
11/30/2020

A Kaczmarz Method with Simple Random Sampling for Solving Large Linear Systems

The Kaczmarz method is a popular iterative scheme for solving large-scal...
research
10/10/2021

Selectable Set Randomized Kaczmarz

The Randomized Kaczmarz method (RK) is a stochastic iterative method for...
research
12/24/2020

Stochastic Steepest Descent Methods for Linear Systems: Greedy Sampling Momentum

Recently proposed adaptive Sketch Project (SP) methods connect sever...
research
12/29/2021

Adaptively Sketched Bregman Projection Methods for Linear Systems

The sketch-and-project, as a general archetypal algorithm for solving li...

Please sign up or login with your details

Forgot password? Click here to reset