Breaking the curse of dimensionality in regression

08/01/2017
by   Yinchu Zhu, et al.
0

Models with many signals, high-dimensional models, often impose structures on the signal strengths. The common assumption is that only a few signals are strong and most of the signals are zero or close (collectively) to zero. However, such a requirement might not be valid in many real-life applications. In this article, we are interested in conducting large-scale inference in models that might have signals of mixed strengths. The key challenge is that the signals that are not under testing might be collectively non-negligible (although individually small) and cannot be accurately learned. This article develops a new class of tests that arise from a moment matching formulation. A virtue of these moment-matching statistics is their ability to borrow strength across features, adapt to the sparsity size and exert adjustment for testing growing number of hypothesis. GRoup-level Inference of Parameter, GRIP, test harvests effective sparsity structures with hypothesis formulation for an efficient multiple testing procedure. Simulated data showcase that GRIPs error control is far better than the alternative methods. We develop a minimax theory, demonstrating optimality of GRIP for a broad range of models, including those where the model is a mixture of a sparse and high-dimensional dense signals.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/10/2016

Linear Hypothesis Testing in Dense High-Dimensional Linear Models

We propose a methodology for testing linear hypothesis in high-dimension...
research
10/07/2016

Significance testing in non-sparse high-dimensional linear models

In high-dimensional linear models, the sparsity assumption is typically ...
research
10/14/2016

Two-sample testing in non-sparse high-dimensional linear models

In analyzing high-dimensional models, sparsity of the model parameter is...
research
11/04/2022

Signal Recovery With Multistage Tests And Without Sparsity Constraints

A signal recovery problem is considered, where the same binary testing p...
research
02/26/2018

Testability of high-dimensional linear models with non-sparse structures

This paper studies hypothesis testing and confidence interval constructi...
research
08/14/2017

Fixed effects testing in high-dimensional linear mixed models

Many scientific and engineering challenges -- ranging from pharmacokinet...

Please sign up or login with your details

Forgot password? Click here to reset