Computing a Sparse Projection into a Box

04/11/2022
by   Dominique Orban, et al.
0

We describe a procedure to compute a projection of w ∈ℝ^n into the intersection of the so-called zero-norm ball k 𝔹_0 of radius k, i.e., the set of k-sparse vectors, with a box centered at a point of k 𝔹_0. The need for such projection arises in the context of certain trust-region methods for nonsmooth regularized optimization. Although the set into which we wish to project is nonconvex, we show that a solution may be found in O(n log(n)) operations. We describe our Julia implementation and illustrate our procedure in the context of two trust-region methods for nonsmooth regularized optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2021

An Iteratively Reweighted Method for Sparse Optimization on Nonconvex ℓ_p Ball

This paper is intended to solve the nonconvex ℓ_p-ball constrained nonli...
research
01/22/2021

Differentiable Trust Region Layers for Deep Reinforcement Learning

Trust region methods are a popular tool in reinforcement learning as the...
research
04/13/2020

A globally convergent method to accelerate topology optimization using on-the-fly model reduction

We present a globally convergent method to accelerate density-based topo...
research
11/29/2022

Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems

We propose a trust-region stochastic sequential quadratic programming al...
research
07/02/2023

A re-examination to the SCoTLASS problems for SPCA and two projection-based methods for them

SCoTLASS is the first sparse principal component analysis (SPCA) model w...
research
04/10/2019

New Computational and Statistical Aspects of Regularized Regression with Application to Rare Feature Selection and Aggregation

Prior knowledge on properties of a target model often come as discrete o...
research
02/19/2021

A comparison of eigenvalue-based algorithms and the generalized Lanczos trust-region algorithm for Solving the trust-region subproblem

Solving the trust-region subproblem (TRS) plays a key role in numerical ...

Please sign up or login with your details

Forgot password? Click here to reset