Effcient Projection Onto the Nonconvex ℓ_p-ball

01/05/2021
by   Hao Wang, et al.
8

This paper primarily focuses on computing the Euclidean projection of a vector onto the ℓ_p-ball with p∈(0,1). Such a problem emerges as the core building block in many signal processing and machine learning applications because of its ability to promote sparsity, yet it is challenging to solve due to its nonconvex and nonsmooth nature. First-order necessary optimality conditions of this problem are derived using Fréchet normal cone. We develop a novel numerical approach for computing the stationary point through solving a sequence of projections onto the reweighted ℓ_1-balls. This method is shown to converge uniquely under mild conditions and has a worst-case O(1/√(k)) convergence rate. Numerical experiments demonstrate the efficiency of our proposed algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2021

An Iteratively Reweighted Method for Sparse Optimization on Nonconvex ℓ_p Ball

This paper is intended to solve the nonconvex ℓ_p-ball constrained nonli...
research
11/10/2019

A unified approach for projections onto the intersection of ℓ_1 and ℓ_2 balls or spheres

This paper focuses on designing a unified approach for computing the pro...
research
08/08/2023

Minimizing Quotient Regularization Model

Quotient regularization models (QRMs) are a class of powerful regulariza...
research
10/27/2021

Constrained Optimization Involving Nonconvex ℓ_p Norms: Optimality Conditions, Algorithm and Convergence

This paper investigates the optimality conditions for characterizing the...
research
07/19/2023

Near-Linear Time Projection onto the ℓ_1,∞ Ball; Application to Sparse Autoencoders

Looking for sparsity is nowadays crucial to speed up the training of lar...
research
09/07/2020

Efficient Projection Algorithms onto the Weighted l1 Ball

Projected gradient descent has been proved efficient in many optimizatio...
research
04/10/2023

A Power Method for Computing the Dominant Eigenvalue of a Dual Quaternion Hermitian Matrix

In this paper, we first study the projections onto the set of unit dual ...

Please sign up or login with your details

Forgot password? Click here to reset