Local Inference in Additive Models with Decorrelated Local Linear Estimator

07/30/2019
by   Zijian Guo, et al.
0

Additive models, as a natural generalization of linear regression, have played an important role in studying nonlinear relationships. Despite of a rich literature and many recent advances on the topic, the statistical inference problem in additive models is still relatively poorly understood. Motivated by the inference for the exposure effect and other applications, we tackle in this paper the statistical inference problem for f_1'(x_0) in additive models, where f_1 denotes the univariate function of interest and f_1'(x_0) denotes its first order derivative evaluated at a specific point x_0. The main challenge for this local inference problem is the understanding and control of the additional uncertainty due to the need of estimating other components in the additive model as nuisance functions. To address this, we propose a decorrelated local linear estimator, which is particularly useful in reducing the effect of the nuisance function estimation error on the estimation accuracy of f'_1(x_0). We establish the asymptotic limiting distribution for the proposed estimator and then construct confidence interval and hypothesis testing procedures for f_1'(x_0). The variance level of the proposed estimator is of the same order as that of the local least squares in nonparametric regression, or equivalently the additive model with one component, while the bias of the proposed estimator is jointly determined by the statistical accuracies in estimating the nuisance functions and the relationship between the variable of interest and the nuisance variables. The method is developed for general additive models and is demonstrated in the high-dimensional sparse setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2021

SIHR: An R Package for Statistical Inference in High-dimensional Linear and Logistic Regression Models

We introduce and illustrate through numerical examples the R package wh...
research
07/03/2023

Inference for Projection Parameters in Linear Regression: beyond d = o(n^1/2)

We consider the problem of inference for projection parameters in linear...
research
03/31/2022

Estimation and inference for high-dimensional nonparametric additive instrumental-variables regression

The method of instrumental variables provides a fundamental and practica...
research
11/15/2020

Inference for High-dimensional Maximin Effects in Heterogeneous Regression Models Using a Sampling Approach

Heterogeneity is an important feature of modern data sets and a central ...
research
04/06/2018

Least Squares Wavelet-based Estimation for Additive Regression Models using Non Equally-Spaced Designs

Additive regression models are actively researched in the statistical fi...
research
09/10/2020

Statistical Inference for Generalized Additive Partially Linear Model

The Generalized Additive Model (GAM) is a powerful tool and has been wel...
research
12/28/2017

Machine Learning for Partial Identification: Example of Bracketed Data

Partially identified models occur commonly in economic applications. A c...

Please sign up or login with your details

Forgot password? Click here to reset