Adaptive Testing for High-dimensional Data

03/14/2023
by   Yangfan Zhang, et al.
0

In this article, we propose a class of L_q-norm based U-statistics for a family of global testing problems related to high-dimensional data. This includes testing of mean vector and its spatial sign, simultaneous testing of linear model coefficients, and testing of component-wise independence for high-dimensional observations, among others. Under the null hypothesis, we derive asymptotic normality and independence between L_q-norm based U-statistics for several qs under mild moment and cumulant conditions. A simple combination of two studentized L_q-based test statistics via their p-values is proposed and is shown to attain great power against alternatives of different sparsity. Our work is a substantial extension of He et al. (2021), which is mostly focused on mean and covariance testing, and we manage to provide a general treatment of asymptotic independence of L_q-norm based U-statistics for a wide class of kernels. To alleviate the computation burden, we introduce a variant of the proposed U-statistics by using the monotone indices in the summation, resulting in a U-statistic with asymmetric kernel. A dynamic programming method is introduced to reduce the computational cost from O(n^qr), which is required for the calculation of the full U-statistic, to O(n^r) where r is the order of the kernel. Numerical studies further corroborate the advantage of the proposed adaptive test as compared to some existing competitors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2018

Asymptotically Independent U-Statistics in High-Dimensional Testing

Many high-dimensional hypothesis tests aim to globally examine marginal ...
research
01/29/2021

Adaptive Inference for Change Points in High-Dimensional Data

In this article, we propose a class of test statistics for a change poin...
research
04/19/2019

Note on Mean Vector Testing for High-Dimensional Dependent Observations

For the mean vector test in high dimension, Ayyala et al.(2017,153:136-1...
research
05/02/2022

Computationally efficient and data-adaptive changepoint inference in high dimension

High-dimensional changepoint inference that adapts to various change pat...
research
01/18/2021

Adaptive Change Point Monitoring for High-Dimensional Data

In this paper, we propose a class of monitoring statistics for a mean sh...
research
07/02/2021

Generalized Multivariate Signs for Nonparametric Hypothesis Testing in High Dimensions

High-dimensional data, where the dimension of the feature space is much ...
research
12/20/2017

Adaptive Mantel Test for Penalized Inference, with Applications to Imaging Genetics

Mantel's test (MT) for association is conducted by testing the linear re...

Please sign up or login with your details

Forgot password? Click here to reset