Sparse Reduced-Rank Regression for Simultaneous Rank and Variable Selection via Manifold Optimization

10/11/2019
by   Kohei Yoshikawa, et al.
0

We consider the problem of constructing a reduced-rank regression model whose coefficient parameter is represented as a singular value decomposition with sparse singular vectors. The traditional estimation procedure for the coefficient parameter often fails when the true rank of the parameter is high. To overcome this issue, we develop an estimation algorithm with rank and variable selection via sparse regularization and manifold optimization, which enables us to obtain an accurate estimation of the coefficient parameter even if the true rank of the coefficient parameter is high. Using sparse regularization, we can also select an optimal value of the rank. We conduct Monte Carlo experiments and real data analysis to illustrate the effectiveness of our proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2020

Sparse principal component regression via singular value decomposition approach

Principal component regression (PCR) is a two-stage procedure: the first...
research
02/15/2021

Efficient Bayesian reduced rank regression using Langevin Monte Carlo approach

The problem of Bayesian reduced rank regression is considered in this pa...
research
10/28/2017

Cox's proportional hazards model with a high-dimensional and sparse regression parameter

This paper deals with the proportional hazards model proposed by D. R. C...
research
03/05/2019

Reduced-rank Analysis of the Total Least Squares

The reduced-rank method exploits the distortion-variance tradeoff to yie...
research
07/29/2021

Sparse estimation for generalized exponential marked Hawkes process

We have established a sparse estimation method for the generalized expon...
research
12/30/2018

On Cross-validation for Sparse Reduced Rank Regression

In high-dimensional data analysis, regularization methods pursuing spars...
research
06/17/2022

Optimal quasi-Bayesian reduced rank regression with incomplete response

The aim of reduced rank regression is to connect multiple response varia...

Please sign up or login with your details

Forgot password? Click here to reset