Using prior information to boost power in correlation structure support recovery

11/22/2021
by   Ziyang Ding, et al.
0

Hypothesis testing of structure in correlation and covariance matrices is of broad interest in many application areas. In high dimensions and/or small to moderate sample sizes, high error rates in testing is a substantial concern. This article focuses on increasing power through a frequentist assisted by Bayes (FAB) procedure. This FAB approach boosts power by including prior information on the correlation parameters. In particular, we suppose there is one of two sources of prior information: (i) a prior dataset that is distinct from the current data but related enough that it may contain valuable information about the correlation structure in the current data; and (ii) knowledge about a tendency for the correlations in different parameters to be similar so that it is appropriate to consider a hierarchical model. When the prior information is relevant, the proposed FAB approach can have significant gains in power. A divide-and-conquer algorithm is developed to reduce computational complexity in massive testing dimensions. We show improvements in power for detecting correlated gene pairs in genomic studies while maintaining control of Type I error or false discover rate (FDR).

READ FULL TEXT

page 16

page 22

research
04/26/2017

A Flexible Framework for Hypothesis Testing in High-dimensions

Hypothesis testing in the linear regression model is a fundamental stati...
research
12/04/2018

Test of Covariance and Correlation Matrices

Based on a generalized cosine measure between two symmetric matrices, we...
research
04/16/2020

Smaller p-values in genomics studies using distilled historical information

Medical research institutions have generated massive amounts of biologic...
research
06/18/2017

Kernel Two-Sample Hypothesis Testing Using Kernel Set Classification

The two-sample hypothesis testing problem is studied for the challenging...
research
03/18/2018

Testing for equal correlation matrices with application to paired gene expression data

We present a novel method for testing the hypothesis of equality of two ...
research
09/12/2017

Discovering Potential Correlations via Hypercontractivity

Discovering a correlation from one variable to another variable is of fu...
research
07/14/2021

Comparison of Canonical Correlation and Partial Least Squares analyses of simulated and empirical data

In this paper, we compared the general forms of CCA and PLS on three sim...

Please sign up or login with your details

Forgot password? Click here to reset