Assessing the goodness of fit of linear regression via higher-order least squares

09/29/2021
by   Christoph Schultheiss, et al.
0

We introduce a simple diagnostic test for assessing the goodness of fit of linear regression, and in particular for detecting hidden confounding. We propose to evaluate the sensitivity of the regression coefficient with respect to changes of the marginal distribution of covariates by comparing the so-called higher-order least squares with the usual least squares estimates. In spite of its simplicity, this strategy is extremely general and powerful. Specifically, we show that it allows to distinguish between confounded and unconfounded predictor variables as well as determining ancestor variables in structural equation models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/07/2018

Correlation Estimation System Minimization Compared to Least Squares Minimization in Simple Linear Regression

A general method of minimization using correlation coefficients and orde...
research
09/30/2022

A note on centering in subsample selection for linear regression

Centering is a commonly used technique in linear regression analysis. Wi...
research
10/22/2018

Average group effect of strongly correlated predictor variables is estimable

It is well known that individual parameters of strongly correlated predi...
research
09/19/2023

A New Bootstrap Goodness-of-Fit Test for Normal Linear Regression Models

In this work, the distributional properties of the goodness-of-fit term ...
research
09/27/2018

Model-free Study of Ordinary Least Squares Linear Regression

Ordinary least squares (OLS) linear regression is one of the most basic ...
research
06/05/2019

A Model-free Approach to Linear Least Squares Regression with Exact Probabilities and Applications to Covariate Selection

The classical model for linear regression is Y= xβ +σε with i.i.d. stan...
research
09/16/2020

An Intrinsic Treatment of Stochastic Linear Regression

Linear regression is perhaps one of the most popular statistical concept...

Please sign up or login with your details

Forgot password? Click here to reset