Best Subset Selection in Reduced Rank Regression

12/13/2019
by   Canhong Wen, et al.
0

Reduced rank regression is popularly used for modeling the relationship and uncovering the structure between multivariate responses and multivariate predictors in genetics. It is especially challenging when predictors are high-dimensional, in which case subset selection is considered to reduce model complexity and enhance model interpretability. We propose a novel selection scheme to directly identify the best subset of predictors via a primal dual formulation. Based on it, we develop a computational efficient algorithm that can be scalable to high-dimensional data with guaranteed convergence. We show that the estimator from the proposed algorithm enjoys nice sampling properties including consistency in estimation, rank and sparsity selection under wild regularity conditions. Further in the practical stage, the new estimator achieves competitive numerical performance under a variety of simulation settings and at the same time allows significantly fast computation. The effectiveness of the proposed method is also demonstrated on an ovarian cancer genetic dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2023

A Consistent and Scalable Algorithm for Best Subset Selection in Single Index Models

Analysis of high-dimensional data has led to increased interest in both ...
research
09/08/2020

Conditional Uncorrelation and Efficient Non-approximate Subset Selection in Sparse Regression

Given m d-dimensional responsors and n d-dimensional predictors, sparse ...
research
11/29/2022

Simultaneous Best Subset Selection and Dimension Reduction via Primal-Dual Iterations

Sparse reduced rank regression is an essential statistical learning meth...
research
04/15/2023

Multivariate regression modeling in integrative analysis via sparse regularization

The multivariate regression model basically offers the analysis of a sin...
research
12/17/2021

Supervised Multivariate Learning with Simultaneous Feature Auto-grouping and Dimension Reduction

Modern high-dimensional methods often adopt the "bet on sparsity" princi...
research
03/24/2020

Interaction Pursuit Biconvex Optimization

Multivariate regression models are widely used in various fields such as...
research
09/19/2017

BeSS: An R Package for Best Subset Selection in Linear, Logistic and CoxPH Models

We introduce a new R package, BeSS, for solving the best subset selectio...

Please sign up or login with your details

Forgot password? Click here to reset