Projected Neural Network for a Class of Sparse Regression with Cardinality Penalty

04/02/2020
by   Wenjing Li, et al.
0

In this paper, we consider a class of sparse regression problems, whose objective function is the summation of a convex loss function and a cardinality penalty. By constructing a smoothing function for the cardinality function, we propose a projected neural network and design a correction method for solving this problem. The solution of the proposed neural network is unique, global existent, bounded and globally Lipschitz continuous. Besides, we prove that all accumulation points of the proposed neural network have a common support set and a unified lower bound for the nonzero entries. Combining the proposed neural network with the correction method, any corrected accumulation point is a local minimizer of the considered sparse regression problem. Moreover, we analyze the equivalent relationship on the local minimizers between the considered sparse regression problem and another sparse problem. Finally, some numerical experiments are provided to show the efficiency of the proposed neural networks in solving some sparse regression problems in practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/10/2012

Sparse Approximation via Penalty Decomposition Methods

In this paper we consider sparse approximation problems, that is, genera...
research
09/29/2015

Optimization over Sparse Symmetric Sets via a Nonmonotone Projected Gradient Method

We consider the problem of minimizing a Lipschitz differentiable functio...
research
10/25/2021

Communication-Efficient Distributed Quantile Regression with Optimal Statistical Guarantees

We address the problem of how to achieve optimal inference in distribute...
research
04/28/2019

Support Vector Regression via a Combined Reward Cum Penalty Loss Function

In this paper, we introduce a novel combined reward cum penalty loss fun...
research
05/11/2019

Sparse Optimization Problem with s-difference Regularization

In this paper, a s-difference type regularization for sparse recovery pr...
research
08/31/2010

Penalty Decomposition Methods for L0-Norm Minimization

In this paper we consider general l0-norm minimization problems, that is...
research
04/24/2020

Nonconvex penalization for sparse neural networks

Training methods for artificial neural networks often rely on over-param...

Please sign up or login with your details

Forgot password? Click here to reset