Sparse Reduced Rank Regression With Nonconvex Regularization

03/20/2018
by   Ziping Zhao, et al.
0

In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The problem is formulated to minimize the least squares loss with a sparsity-inducing penalty considering an orthogonality constraint. Convex sparsity-inducing functions have been used for SRRR in literature. In this work, a nonconvex function is proposed for better sparsity inducing. An efficient algorithm is developed based on the alternating minimization (or projection) method to solve the nonconvex optimization problem. Numerical simulations show that the proposed algorithm is much more efficient compared to the benchmark methods and the nonconvex function can result in a better estimation accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2018

Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learning

In the past decade, sparse and low-rank recovery have drawn much attenti...
research
09/13/2017

Alternating minimization and alternating descent over nonconvex sets

We analyze the performance of alternating minimization for loss function...
research
10/16/2017

Robust Maximum Likelihood Estimation of Sparse Vector Error Correction Model

In econometrics and finance, the vector error correction model (VECM) is...
research
11/29/2022

Simultaneous Best Subset Selection and Dimension Reduction via Primal-Dual Iterations

Sparse reduced rank regression is an essential statistical learning meth...
research
04/16/2019

Risk Bounds for Learning Multiple Components with Permutation-Invariant Losses

This paper proposes a simple approach to derive efficient error bounds f...
research
09/11/2018

An Efficient ADMM-Based Algorithm to Nonconvex Penalized Support Vector Machines

Support vector machines (SVMs) with sparsity-inducing nonconvex penaltie...
research
04/15/2016

Positive Definite Estimation of Large Covariance Matrix Using Generalized Nonconvex Penalties

This work addresses the issue of large covariance matrix estimation in h...

Please sign up or login with your details

Forgot password? Click here to reset