Asymptotic results for nonparametric regression estimators after sufficient dimension reduction estimation

06/18/2023
by   Liliana Forzani, et al.
0

Prediction, in regression and classification, is one of the main aims in modern data science. When the number of predictors is large, a common first step is to reduce the dimension of the data. Sufficient dimension reduction (SDR) is a well established paradigm of reduction that keeps all the relevant information in the covariates X that is necessary for the prediction of Y . In practice, SDR has been successfully used as an exploratory tool for modelling after estimation of the sufficient reduction. Nevertheless, even if the estimated reduction is a consistent estimator of the population, there is no theory that supports this step when non-parametric regression is used in the imputed estimator. In this paper, we show that the asymptotic distribution of the non-parametric regression estimator is the same regardless if the true SDR or its estimator is used. This result allows making inferences, for example, computing confidence intervals for the regression function avoiding the curse of dimensionality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2021

Fusing Sufficient Dimension Reduction with Neural Networks

We consider the regression problem where the dependence of the response ...
research
02/11/2023

Dimension Reduction and MARS

The multivariate adaptive regression spline (MARS) is one of the popular...
research
09/30/2020

Facilitate the Parametric Dimension Reduction by Gradient Clipping

We extend a well-known dimension reduction method, t-distributed stochas...
research
05/17/2022

On Semiparametric Efficiency of an Emerging Class of Regression Models for Between-subject Attributes

The semiparametric regression models have attracted increasing attention...
research
08/06/2013

On b-bit min-wise hashing for large-scale regression and classification with sparse data

Large-scale regression problems where both the number of variables, p, a...
research
06/05/2020

The Expected Jacobian Outerproduct: Theory and Empirics

The expected gradient outerproduct (EGOP) of an unknown regression funct...
research
07/13/2023

Choice Models and Permutation Invariance

Choice Modeling is at the core of many economics, operations, and market...

Please sign up or login with your details

Forgot password? Click here to reset