DeepAI AI Chat
Log In Sign Up

Slice Weighted Average Regression

09/10/2022
by   Marina Masioti, et al.
La Trobe University
0

It has previously been shown that ordinary least squares can be used to estimate the coefficients of the single-index model under only mild conditions. However, the estimator is non-robust leading to poor estimates for some models. In this paper we propose a new sliced least-squares estimator that utilizes ideas from Sliced Inverse Regression. Slices with problematic observations that contribute to high variability in the estimator can easily be down-weighted to robustify the procedure. The estimator is simple to implement and can result in vast improvements for some models when compared to the usual least-squares approach. While the estimator was initially conceived with the single-index model in mind, we also show that multiple directions can be obtained, therefore providing another notable advantage of using slicing with least squares. Several simulation studies and a real data example are included, as well as some comparisons with some other recent methods.

READ FULL TEXT

page 8

page 9

page 10

page 14

10/11/2021

Two-stage least squares with a randomly right censored outcome

This note develops a simple two-stage least squares (2SLS) procedure to ...
09/30/2022

A note on centering in subsample selection for linear regression

Centering is a commonly used technique in linear regression analysis. Wi...
01/18/2017

Surrogate Aided Unsupervised Recovery of Sparse Signals in Single Index Models for Binary Outcomes

We consider the recovery of regression coefficients, denoted by β_0, for...
03/10/2020

Estimating multi-index models with response-conditional least squares

The multi-index model is a simple yet powerful high-dimensional regressi...
12/04/2018

The Lagrange approach in the monotone single index model

The finite-dimensional parameters of the monotone single index model are...
06/17/2021

Distributionally Weighted Least Squares in Structural Equation Modeling

In real data analysis with structural equation modeling, data are unlike...
03/22/2016

Feeling the Bern: Adaptive Estimators for Bernoulli Probabilities of Pairwise Comparisons

We study methods for aggregating pairwise comparison data in order to es...