Linear Hypothesis Testing in Dense High-Dimensional Linear Models

10/10/2016
by   Yinchu Zhu, et al.
0

We propose a methodology for testing linear hypothesis in high-dimensional linear models. The proposed test does not impose any restriction on the size of the model, i.e. model sparsity or the loading vector representing the hypothesis. Providing asymptotically valid methods for testing general linear functions of the regression parameters in high-dimensions is extremely challenging -- especially without making restrictive or unverifiable assumptions on the number of non-zero elements. We propose to test the moment conditions related to the newly designed restructured regression, where the inputs are transformed and augmented features. These new features incorporate the structure of the null hypothesis directly. The test statistics are constructed in such a way that lack of sparsity in the original model parameter does not present a problem for the theoretical justification of our procedures. We establish asymptotically exact control on Type I error without imposing any sparsity assumptions on model parameter or the vector representing the linear hypothesis. Our method is also shown to achieve certain optimality in detecting deviations from the null hypothesis. We demonstrate the favorable finite-sample performance of the proposed methods, via a number of numerical and a real data example.

READ FULL TEXT

page 19

page 20

page 21

page 22

research
10/14/2016

Two-sample testing in non-sparse high-dimensional linear models

In analyzing high-dimensional models, sparsity of the model parameter is...
research
05/02/2017

A projection pursuit framework for testing general high-dimensional hypothesis

This article develops a framework for testing general hypothesis in high...
research
12/16/2022

Score function-based tests for ultrahigh-dimensional linear models

To sufficiently exploit the model structure under the null hypothesis su...
research
08/01/2017

Breaking the curse of dimensionality in regression

Models with many signals, high-dimensional models, often impose structur...
research
10/07/2016

Significance testing in non-sparse high-dimensional linear models

In high-dimensional linear models, the sparsity assumption is typically ...
research
02/26/2018

Testability of high-dimensional linear models with non-sparse structures

This paper studies hypothesis testing and confidence interval constructi...
research
05/20/2019

Integrated conditional moment test and beyond: when the number of covariates is divergent

The classic integrated conditional moment test is a promising method for...

Please sign up or login with your details

Forgot password? Click here to reset