DeepAI AI Chat
Log In Sign Up

Efficient Estimation in Convex Single Index Models

08/01/2017
by   Arun K. Kuchibhotla, et al.
0

We consider estimation and inference in a single index regression model with an unknown convex link function. We propose two estimators for the unknown link function: (1) a Lipschitz constrained least squares estimator and (2) a shape-constrained smoothing spline estimator. Moreover, both of these procedures lead to estimators for the unknown finite dimensional parameter. We develop methods to compute both the Lipschitz constrained least squares estimator (LLSE) and the penalized least squares estimator (PLSE) of the parametric and the nonparametric components given independent and identically distributed (i.i.d.) data. We prove the consistency and find the rates of convergence for both the LLSE and the PLSE. For both the LLSE and the PLSE, we establish n^-1/2-rate of convergence and semiparametric efficiency of the parametric component under mild assumptions. Moreover, both the LLSE and the PLSE readily yield asymptotic confidence sets for the finite dimensional parameter. We develop the R package "simest" to compute the proposed estimators. Our proposed algorithm works even when n is modest and d is large (e.g., n = 500, and d = 100).

READ FULL TEXT

page 1

page 2

page 3

page 4

01/15/2020

Profile least squares estimators in the monotone single index model

We consider least squares estimators of the finite dimensional regressio...
07/15/2021

Nonparametric, tuning-free estimation of S-shaped functions

We consider the nonparametric estimation of an S-shaped regression funct...
10/13/2017

On Integrated L^1 Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations

We consider a general monotone regression estimation where we allow for ...
02/23/2020

Conditional regression for single-index models

The single-index model is a statistical model for intrinsic regression w...
03/10/2020

Estimating multi-index models with response-conditional least squares

The multi-index model is a simple yet powerful high-dimensional regressi...
09/22/2020

Nonparametric least squares estimation in integer-valued GARCH models

We consider a nonparametric version of the integer-valued GARCH(1,1) mod...
04/14/2022

Observable adjustments in single-index models for regularized M-estimators

We consider observations (X,y) from single index models with unknown lin...