A Flexible Framework for Hypothesis Testing in High-dimensions

04/26/2017
by   Adel Javanmard, et al.
0

Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high-dimensional regime where the number of parameters exceeds the number of samples (p> n) and assume that the high-dimensional parameters vector is s_0 sparse. We develop a general and flexible ℓ_∞ projection statistic for hypothesis testing in this model. Our framework encompasses testing whether the parameter lies in a convex cone, testing the signal strength, testing arbitrary functionals of the parameter, and testing adaptive hypothesis. We show that the proposed procedure controls the type I error under the standard assumption of s_0 ( p)/√(n)→ 0, and also analyze the power of the procedure. Our numerical experiments confirms our theoretical findings and demonstrate that we control false positive rate (type I error) near the nominal level, and have high power.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2022

Testing Heteroskedasticity in High-Dimensional Linear Regression

We propose a new testing procedure of heteroskedasticity in high-dimensi...
research
07/22/2021

Dimension-Free Anticoncentration Bounds for Gaussian Order Statistics with Discussion of Applications to Multiple Testing

The following anticoncentration property is proved. The probability that...
research
06/10/2020

A fundamental problem of hypothesis testing with finite inventory in e-commerce

In this paper, we draw attention to a problem that is often overlooked o...
research
11/22/2021

Using prior information to boost power in correlation structure support recovery

Hypothesis testing of structure in correlation and covariance matrices i...
research
10/22/2020

Drift Detection in Episodic Data: Detect When Your Agent Starts Faltering

Detection of deterioration of agent performance in dynamic environments ...
research
11/17/2019

Constrained High Dimensional Statistical Inference

In typical high dimensional statistical inference problems, confidence i...
research
04/29/2019

Individualized Treatment Selection: An Optimal Hypothesis Testing Approach In High-dimensional Models

The ability to predict individualized treatment effects (ITEs) based on ...

Please sign up or login with your details

Forgot password? Click here to reset