Profile least squares estimators in the monotone single index model

01/15/2020
by   Fadoua Balabdaoui, et al.
0

We consider least squares estimators of the finite dimensional regression parameter α in the single index regression model Y=ψ(α^TX)+ϵ, where X is a d-dimensional random vector, E(Y|X)=ψ(α^TX), and where ψ is monotone. It has been suggested to estimate α by a profile least squares estimator, minimizing ∑_i=1^n(Y_i-ψ(α^TX_i))^2 over monotone ψ and α on the boundary S_d-1of the unit ball. Although this suggestion has been around for a long time, it is still unknown whether the estimate is √(n) convergent. We show that a profile least squares estimator, using the same pointwise least squares estimator for fixed α, but using a different global sum of squares, is √(n)-convergent and asymptotically normal. The difference between the corresponding loss functions is studied and also a comparison with other methods is given. An augmented Lagrange method, embedded in the Hooke-Jeeves pattern search algorithm, is implemented in R to compute the profile least squares estimators.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2018

The Lagrange approach in the monotone single index model

The finite-dimensional parameters of the monotone single index model are...
research
12/15/2017

Score estimation in the monotone single index model

We consider estimation of the regression parameter in the single index m...
research
08/01/2017

Efficient Estimation in Convex Single Index Models

We consider estimation and inference in a single index regression model ...
research
03/09/2020

Least Squares Estimation of a Monotone Quasiconvex Regression Function

We develop a new approach for the estimation of a multivariate function ...
research
01/08/2019

Monotone Least Squares and Isotonic Quantiles

We consider bivariate observations (X_1,Y_1),...,(X_n,Y_n) such that, co...
research
06/22/2018

Removing the Curse of Superefficiency: an Effective Strategy For Distributed Computing in Isotonic Regression

We propose a strategy for computing the isotonic least-squares estimate ...
research
09/18/2023

Error Reduction from Stacked Regressions

Stacking regressions is an ensemble technique that forms linear combinat...

Please sign up or login with your details

Forgot password? Click here to reset