Multiple Linear Regression and Correlation: A Geometric Analysis

09/13/2021
by   Ben O'Neill, et al.
0

In this review article we consider linear regression analysis from a geometric perspective, looking at standard methods and outputs in terms of the lengths of the relevant vectors and the angles between these vectors. We show that standard regression output can be written in terms of the lengths and angles between the various input vectors, such that this geometric information is sufficient in linear regression problems. This allows us to obtain a standard formula for multiple correlation and give a geometric interpretation to this. We examine how multicollinearity affects the total explanatory power of the data, and we examine a counter-intuitive phenomena called "enhancement" where the total information from the explanatory vectors is greater than the sum of the marginal parts.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

07/12/2020

Multiplicative Perturbation Bounds for Multivariate Multiple Linear Regression in Schatten p-Norms

Multivariate multiple linear regression (MMLR), which occurs in a number...
08/17/2021

Testing Multiple Linear Regression Systems with Metamorphic Testing

Regression is one of the most commonly used statistical techniques. Howe...
07/10/2019

Sparse Unit-Sum Regression

This paper considers sparsity in linear regression under the restriction...
09/13/2016

Self-Sustaining Iterated Learning

An important result from psycholinguistics (Griffiths & Kalish, 2005) st...
03/17/2022

An alternative Interpretation of residual feed intake by phenotypic recursive relationships in dairy cattle

There has been an increasing interest in residual feed intake (RFI) as a...
12/02/2020

Linear Regression Evaluation of Search Engine Automatic Search Performance Based on Hadoop and R

The automatic search performance of search engines has become an essenti...
12/23/2020

Direct Estimation of Spinal Cobb Angles by Structured Multi-Output Regression

The Cobb angle that quantitatively evaluates the spinal curvature plays ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.