Prediction regions through Inverse Regression

07/09/2018
by   Emilie Devijver, et al.
0

Predict a new response from a covariate is a challenging task in regression, which raises new question since the era of high-dimensional data. In this paper, we are interested in the inverse regression method from a theoretical viewpoint. Theoretical results have already been derived for the well-known linear model, but recently, the curse of dimensionality has increased the interest of practitioners and theoreticians into generalization of those results for various estimators, calibrated for the high-dimension context. To deal with high-dimensional data, inverse regression is used in this paper. It is known to be a reliable and efficient approach when the number of features exceeds the number of observations. Indeed, under some conditions, dealing with the inverse regression problem associated to a forward regression problem drastically reduces the number of parameters to estimate and make the problem tractable. When both the responses and the covariates are multivariate, estimators constructed by the inverse regression are studied in this paper, the main result being explicit asymptotic prediction regions for the response. The performances of the proposed estimators and prediction regions are also analyzed through a simulation study and compared with usual estimators.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2021

Improved Estimators for Semi-supervised High-dimensional Regression Model

We study a linear high-dimensional regression model in a semi-supervised...
research
02/02/2022

A selective review of sufficient dimension reduction for multivariate response regression

We review sufficient dimension reduction (SDR) estimators with multivari...
research
11/05/2021

Quantile index regression

Estimating the structures at high or low quantiles has become an importa...
research
03/07/2023

Extremes in High Dimensions: Methods and Scalable Algorithms

Extreme-value theory has been explored in considerable detail for univar...
research
01/11/2023

Multivariate Regression via Enhanced Response Envelope: Envelope Regularization and Double Descent

The envelope model provides substantial efficiency gains over the standa...
research
09/09/2022

Penalization-induced shrinking without rotation in high dimensional GLM regression: a cavity analysis

In high dimensional regression, where the number of covariates is of the...
research
07/02/2020

Sliced Inverse Regression for Spatial Data

Sliced inverse regression is one of the most popular sufficient dimensio...

Please sign up or login with your details

Forgot password? Click here to reset