Joint limiting laws for high-dimensional independence tests

12/30/2015
by   Danning Li, et al.
0

Testing independence is of significant interest in many important areas of large-scale inference. Using extreme-value form statistics to test against sparse alternatives and using quadratic form statistics to test against dense alternatives are two important testing procedures for high-dimensional independence. However, quadratic form statistics suffer from low power against sparse alternatives, and extreme-value form statistics suffer from low power against dense alternatives with small disturbances and may have size distortions due to its slow convergence. For real-world applications, it is important to derive powerful testing procedures against more general alternatives. Based on intermediate limiting distributions, we derive (model-free) joint limiting laws of extreme-value form and quadratic form statistics, and surprisingly, we prove that they are asymptotically independent. Given such asymptotic independencies, we propose (model-free) testing procedures to boost the power against general alternatives and also retain the correct asymptotic size. Under the high-dimensional setting, we derive the closed-form limiting null distributions, and obtain their explicit rates of uniform convergence. We prove their consistent statistical powers against general alternatives. We demonstrate the performance of our proposed test statistics in simulation studies. Our work provides very helpful insights to high-dimensional independence tests, and fills an important gap.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2020

Fisher's combined probability test for high-dimensional covariance matrices

Testing large covariance matrices is of fundamental importance in statis...
research
09/02/2018

Asymptotically Independent U-Statistics in High-Dimensional Testing

Many high-dimensional hypothesis tests aim to globally examine marginal ...
research
04/19/2022

Asymptotic Independence of the Quadratic form and Maximum of Independent Random Variables with Applications to High-Dimensional Tests

This paper establishes the asymptotic independence between the quadratic...
research
11/09/2017

On relations between extreme value statistics, extreme random matrices and Peak-Over-Threshold method

Using the thinning method, we explain the link between classical Fisher-...
research
12/23/2022

Rényi Distillation for Global Testing in Sparse Regression Problems

Many modern high-dimensional regression applications involve testing whe...
research
07/03/2020

Two-sample Testing for Large, Sparse High-Dimensional Multinomials under Rare/Weak Perturbations

Given two samples from possibly different discrete distributions over a ...
research
03/05/2020

Backward CUSUM for Testing and Monitoring Structural Change

It is well known that the conventional CUSUM test suffers from low power...

Please sign up or login with your details

Forgot password? Click here to reset