DeepAI AI Chat
Log In Sign Up

Efficient Estimation in Convex Single Index Models

by   Arun K. Kuchibhotla, et al.

We consider estimation and inference in a single index regression model with an unknown convex link function. We propose two estimators for the unknown link function: (1) a Lipschitz constrained least squares estimator and (2) a shape-constrained smoothing spline estimator. Moreover, both of these procedures lead to estimators for the unknown finite dimensional parameter. We develop methods to compute both the Lipschitz constrained least squares estimator (LLSE) and the penalized least squares estimator (PLSE) of the parametric and the nonparametric components given independent and identically distributed (i.i.d.) data. We prove the consistency and find the rates of convergence for both the LLSE and the PLSE. For both the LLSE and the PLSE, we establish n^-1/2-rate of convergence and semiparametric efficiency of the parametric component under mild assumptions. Moreover, both the LLSE and the PLSE readily yield asymptotic confidence sets for the finite dimensional parameter. We develop the R package "simest" to compute the proposed estimators. Our proposed algorithm works even when n is modest and d is large (e.g., n = 500, and d = 100).


page 1

page 2

page 3

page 4


Profile least squares estimators in the monotone single index model

We consider least squares estimators of the finite dimensional regressio...

Nonparametric, tuning-free estimation of S-shaped functions

We consider the nonparametric estimation of an S-shaped regression funct...

On Integrated L^1 Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations

We consider a general monotone regression estimation where we allow for ...

Conditional regression for single-index models

The single-index model is a statistical model for intrinsic regression w...

Estimating multi-index models with response-conditional least squares

The multi-index model is a simple yet powerful high-dimensional regressi...

Nonparametric least squares estimation in integer-valued GARCH models

We consider a nonparametric version of the integer-valued GARCH(1,1) mod...

Observable adjustments in single-index models for regularized M-estimators

We consider observations (X,y) from single index models with unknown lin...