DeepAI AI Chat
Log In Sign Up

Profile least squares estimators in the monotone single index model

by   Fadoua Balabdaoui, et al.

We consider least squares estimators of the finite dimensional regression parameter α in the single index regression model Y=ψ(α^TX)+ϵ, where X is a d-dimensional random vector, E(Y|X)=ψ(α^TX), and where ψ is monotone. It has been suggested to estimate α by a profile least squares estimator, minimizing ∑_i=1^n(Y_i-ψ(α^TX_i))^2 over monotone ψ and α on the boundary S_d-1of the unit ball. Although this suggestion has been around for a long time, it is still unknown whether the estimate is √(n) convergent. We show that a profile least squares estimator, using the same pointwise least squares estimator for fixed α, but using a different global sum of squares, is √(n)-convergent and asymptotically normal. The difference between the corresponding loss functions is studied and also a comparison with other methods is given. An augmented Lagrange method, embedded in the Hooke-Jeeves pattern search algorithm, is implemented in R to compute the profile least squares estimators.


page 1

page 2

page 3

page 4


The Lagrange approach in the monotone single index model

The finite-dimensional parameters of the monotone single index model are...

Score estimation in the monotone single index model

We consider estimation of the regression parameter in the single index m...

Efficient Estimation in Convex Single Index Models

We consider estimation and inference in a single index regression model ...

Least Squares Estimation of a Monotone Quasiconvex Regression Function

We develop a new approach for the estimation of a multivariate function ...

Monotone Least Squares and Isotonic Quantiles

We consider bivariate observations (X_1,Y_1),...,(X_n,Y_n) such that, co...

Removing the Curse of Superefficiency: an Effective Strategy For Distributed Computing in Isotonic Regression

We propose a strategy for computing the isotonic least-squares estimate ...

Accelerating the pool-adjacent-violators algorithm for isotonic distributional regression

In this note we describe in detail how to apply the pool-adjacent-violat...