AI Chat AI Image Generator AI Video Text to Speech

A Unifying Analysis of Projected Gradient Descent for ℓ_p-constrained Least Squares

07/22/2011

∙

by Sohail Bahmani, et al.

∙

∙

In this paper we study the performance of the Projected Gradient Descent(PGD) algorithm for ℓ_p-constrained least squares problems that arise in the framework of Compressed Sensing. Relying on the Restricted Isometry Property, we provide convergence guarantees for this algorithm for the entire range of 0≤ p≤1, that include and generalize the existing results for the Iterative Hard Thresholding algorithm and provide a new accuracy guarantee for the Iterative Soft Thresholding algorithm as special cases. Our results suggest that in this group of algorithms, as p increases from zero to one, conditions required to guarantee accuracy become stricter and robustness to noise deteriorates.

Sohail Bahmani
13 publications
Bhiksha Raj
84 publications

page 1

page 2

page 3

page 4

research

∙ 12/22/2021

On Asymptotic Linear Convergence of Projected Gradient Descent for Constrained Least Squares

Many recent problems in signal processing and machine learning such as c...

8 Trung Vu, et al. ∙

research

∙ 07/10/2023

Invex Programs: First Order Algorithms and Their Convergence

Invex programs are a special kind of non-convex problems which attain gl...

0 Adarsh Barik, et al. ∙

research

∙ 06/25/2020

Sparse Convex Optimization via Adaptively Regularized Hard Thresholding

The goal of Sparse Convex Optimization is to optimize a convex function ...

0 Kyriakos Axiotis, et al. ∙

research

∙ 04/20/2023

Linear Convergence of Reshuffling Kaczmarz Methods With Sparse Constraints

The Kaczmarz method (KZ) and its variants, which are types of stochastic...

0 Halyun Jeong, et al. ∙

research

∙ 09/12/2023

Optimization Guarantees of Unfolded ISTA and ADMM Networks With Smooth Soft-Thresholding

Solving linear inverse problems plays a crucial role in numerous applica...

0 Shaik Basheeruddin Shah, et al. ∙

research

∙ 10/29/2019

Learning Sparse Distributions using Iterative Hard Thresholding

Iterative hard thresholding (IHT) is a projected gradient descent algori...

0 Jacky Y. Zhang, et al. ∙

research

∙ 09/21/2022

Projected Gradient Descent Algorithms for Solving Nonlinear Inverse Problems with Generative Priors

In this paper, we propose projected gradient descent (PGD) algorithms fo...

0 Zhaoqiang Liu, et al. ∙