Greedy double subspaces coordinate descent method via orthogonalization

03/04/2022
by   Li-Li Jin, et al.
0

The coordinate descent method is an effective iterative method for solving large linear least-squares problems. In this paper, we construct an effective coordinate descent method which iteratively projects the estimate onto a solution space formed by two selected hyperplanes. Our methods may be regarded as a block version of coordinate descent method which incorporates greedy rules. The convergence analysis of this method is provided and numerical simulations also confirm the effectiveness of our new methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2020

A novel greedy Gauss-Seidel method for solving large linear least squares problem

We present a novel greedy Gauss-Seidel method for solving large linear l...
research
02/17/2016

Large Scale Kernel Learning using Block Coordinate Descent

We demonstrate that distributed block coordinate descent can quickly sol...
research
04/06/2020

Greedy Block Gauss-Seidel Methods for Solving Large Linear Least Squares Problem

With a greedy strategy to construct control index set of coordinates fir...
research
12/17/2012

Feature Clustering for Accelerating Parallel Coordinate Descent

Large-scale L1-regularized loss minimization problems arise in high-dime...
research
06/02/2023

Linearly convergent adjoint free solution of least squares problems by random descent

We consider the problem of solving linear least squares problems in a fr...
research
10/16/2018

Efficient Greedy Coordinate Descent for Composite Problems

Coordinate descent with random coordinate selection is the current state...
research
07/03/2023

Analyzing and Improving Greedy 2-Coordinate Updates for Equality-Constrained Optimization via Steepest Descent in the 1-Norm

We consider minimizing a smooth function subject to a summation constrai...

Please sign up or login with your details

Forgot password? Click here to reset