Sliced Inverse Regression with Large Structural Dimensions

05/07/2023
by   Dongming Huang, et al.
0

The central space of a joint distribution (,Y) is the minimal subspace 𝒮 such that Y⊥⊥| P_𝒮 where P_𝒮 is the projection onto 𝒮. Sliced inverse regression (SIR), one of the most popular methods for estimating the central space, often performs poorly when the structural dimension d=dim( 𝒮) is large (e.g., 5). In this paper, we demonstrate that the generalized signal-noise-ratio (gSNR) tends to be extremely small for a general multiple-index model when d is large. Then we determine the minimax rate for estimating the central space over a large class of high dimensional distributions with a large structural dimension d (i.e., there is no constant upper bound on d) in the low gSNR regime. This result not only extends the existing minimax rate results for estimating the central space of distributions with fixed d to that with a large d, but also clarifies that the degradation in SIR performance is caused by the decay of signal strength. The technical tools developed here might be of independent interest for studying other central space estimation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/06/2023

On the Optimality of Functional Sliced Inverse Regression

In this paper, we prove that functional sliced inverse regression (FSIR)...
research
12/01/2021

Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression

We study a minimax risk of estimating inverse functions on a plane, whil...
research
11/11/2022

Signal-to-noise ratio aware minimaxity and higher-order asymptotics

Since its development, the minimax framework has been one of the corner ...
research
09/08/2023

Optimal Rate of Kernel Regression in Large Dimensions

We perform a study on kernel regression for large-dimensional data (wher...
research
04/20/2021

Sparse Sliced Inverse Regression via Cholesky Matrix Penalization

We introduce a new sparse sliced inverse regression estimator called Cho...
research
05/29/2019

Essential regression

Essential Regression is a new type of latent factor regression model, wh...
research
05/09/2023

Sparse Sliced Inverse Regression via Random Projection

We propose a novel sparse sliced inverse regression method based on rand...

Please sign up or login with your details

Forgot password? Click here to reset