Slice Weighted Average Regression

09/10/2022
by   Marina Masioti, et al.
0

It has previously been shown that ordinary least squares can be used to estimate the coefficients of the single-index model under only mild conditions. However, the estimator is non-robust leading to poor estimates for some models. In this paper we propose a new sliced least-squares estimator that utilizes ideas from Sliced Inverse Regression. Slices with problematic observations that contribute to high variability in the estimator can easily be down-weighted to robustify the procedure. The estimator is simple to implement and can result in vast improvements for some models when compared to the usual least-squares approach. While the estimator was initially conceived with the single-index model in mind, we also show that multiple directions can be obtained, therefore providing another notable advantage of using slicing with least squares. Several simulation studies and a real data example are included, as well as some comparisons with some other recent methods.

READ FULL TEXT

page 8

page 9

page 10

page 14

research
10/11/2021

Two-stage least squares with a randomly right censored outcome

This note develops a simple two-stage least squares (2SLS) procedure to ...
research
09/30/2022

A note on centering in subsample selection for linear regression

Centering is a commonly used technique in linear regression analysis. Wi...
research
01/18/2017

Surrogate Aided Unsupervised Recovery of Sparse Signals in Single Index Models for Binary Outcomes

We consider the recovery of regression coefficients, denoted by β_0, for...
research
03/10/2020

Estimating multi-index models with response-conditional least squares

The multi-index model is a simple yet powerful high-dimensional regressi...
research
12/04/2018

The Lagrange approach in the monotone single index model

The finite-dimensional parameters of the monotone single index model are...
research
06/17/2021

Distributionally Weighted Least Squares in Structural Equation Modeling

In real data analysis with structural equation modeling, data are unlike...
research
03/22/2016

Feeling the Bern: Adaptive Estimators for Bernoulli Probabilities of Pairwise Comparisons

We study methods for aggregating pairwise comparison data in order to es...

Please sign up or login with your details

Forgot password? Click here to reset