Multiple Linear Regression and Correlation: A Geometric Analysis

09/13/2021
by   Ben O'Neill, et al.
0

In this review article we consider linear regression analysis from a geometric perspective, looking at standard methods and outputs in terms of the lengths of the relevant vectors and the angles between these vectors. We show that standard regression output can be written in terms of the lengths and angles between the various input vectors, such that this geometric information is sufficient in linear regression problems. This allows us to obtain a standard formula for multiple correlation and give a geometric interpretation to this. We examine how multicollinearity affects the total explanatory power of the data, and we examine a counter-intuitive phenomena called "enhancement" where the total information from the explanatory vectors is greater than the sum of the marginal parts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2020

Multiplicative Perturbation Bounds for Multivariate Multiple Linear Regression in Schatten p-Norms

Multivariate multiple linear regression (MMLR), which occurs in a number...
research
08/17/2021

Testing Multiple Linear Regression Systems with Metamorphic Testing

Regression is one of the most commonly used statistical techniques. Howe...
research
07/13/2023

Evaluation of Active Affiliates to the SIS Multidimensional Analysis in R Shiny

This article presents a study that uses multiple linear regression analy...
research
07/10/2019

Sparse Unit-Sum Regression

This paper considers sparsity in linear regression under the restriction...
research
09/13/2016

Self-Sustaining Iterated Learning

An important result from psycholinguistics (Griffiths & Kalish, 2005) st...
research
09/14/2013

Ultrametric Component Analysis with Application to Analysis of Text and of Emotion

We review the theory and practice of determining what parts of a data se...
research
03/17/2022

An alternative Interpretation of residual feed intake by phenotypic recursive relationships in dairy cattle

There has been an increasing interest in residual feed intake (RFI) as a...

Please sign up or login with your details

Forgot password? Click here to reset