Derivation of the Exact Moments of the Distribution of Pearsons Correlation over Permutations of Data

02/20/2020
by   Marc Jaffrey, et al.
0

Pearson's correlation is one of the most widely used measures of association today, the importance of which to modern science cannot be understated. Two of the most common methods for computing the p-value for a hypothesis test of this correlation method are a t-statistic and permutation sampling. When a dataset comes from a bivariate normal distribution under specific data transformations a t-statistic is exact. However, for datasets which do not follow this stipulation, both approaches are merely estimations of the distribution of over permutations of data. In this paper we explicitly show the dependency of the permutation distribution of Pearson's correlation on the central moments of the data and derive an inductive formula which allows the computation of these exact moments. This has direct implications for computing the p-value for general datasets which could lead to more computationally accurate methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/07/2020

Moments of the Distribution of Pearsons Correlation over Permutations of Data

Presented is an inductive formula for computing the exact moments of the...
research
09/11/2018

T-statistic for Autoregressive process

In this paper, we discuss the distribution of the t-statistic under the ...
research
09/05/2019

The distribution of Yule's 'nonsense correlation'

In 2017, the authors of ernst2017yule explicitly computed the second mom...
research
10/02/2022

Exact first moments of the RV coefficient by invariant orthogonal integration

The RV coefficient measures the similarity between two multivariate conf...
research
09/19/2021

Moments of permutation statistics and central limit theorems

We show that if a permutation statistic can be written as a linear combi...
research
09/10/2019

Method of Moments Histograms

Uniform bin width histograms are widely used so this data graphic should...
research
03/10/2021

Yule's "nonsense correlation" for Gaussian random walks

The purpose of this article is to provide an exact formula for the secon...

Please sign up or login with your details

Forgot password? Click here to reset