A convex formulation for high-dimensional sparse sliced inverse regression

09/17/2018
by   Kean Ming Tan, et al.
2

Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the covariates. The estimated linear combinations include all covariates, making results difficult to interpret and perhaps unnecessarily variable, particularly when the number of covariates is large. In this paper, we propose a convex formulation for fitting sparse sliced inverse regression in high dimensions. Our proposal estimates the subspace of the linear combinations of the covariates directly and performs variable selection simultaneously. We solve the resulting convex optimization problem via the linearized alternating direction methods of multiplier algorithm, and establish an upper bound on the subspace distance between the estimated and the true subspaces. Through numerical studies, we show that our proposal is able to identify the correct covariates in the high-dimensional setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/18/2021

High-Dimensional Sparse Single-Index Regression Via Hilbert-Schmidt Independence Criterion

Hilbert-Schmidt Independence Criterion (HSIC) has recently been used in ...
research
12/15/2020

Certifiably Optimal Sparse Sufficient Dimension Reduction

Sufficient dimension reduction (SDR) is a popular tool in regression ana...
research
05/20/2023

Contrastive inverse regression for dimension reduction

Supervised dimension reduction (SDR) has been a topic of growing interes...
research
02/28/2019

Distance-Based Independence Screening for Canonical Analysis

This paper introduces a new method named Distance-based Independence Scr...
research
04/20/2021

Sparse Sliced Inverse Regression via Cholesky Matrix Penalization

We introduce a new sparse sliced inverse regression estimator called Cho...
research
07/02/2020

Sliced Inverse Regression for Spatial Data

Sliced inverse regression is one of the most popular sufficient dimensio...
research
08/04/2021

Dimension reduction for integrative survival analysis

We propose a constrained maximum partial likelihood estimator for dimens...

Please sign up or login with your details

Forgot password? Click here to reset