DeepAI AI Chat
Log In Sign Up

Global testing under the sparse alternatives for single index models

by   Qian Lin, et al.

For the single index model y=f(β^τx,ϵ) with Gaussian design, and β is a sparse p-dimensional unit vector with at most s nonzero entries, we are interested in testing the null hypothesis that β, when viewed as a whole vector, is zero against the alternative that some entries of β is nonzero. Assuming that var(E[x | y]) is non-vanishing, we define the generalized signal-to-noise ratio (gSNR) λ of the model as the unique non-zero eigenvalue of var(E[x | y]). We show that if s^2^2(p)∧ p is of a smaller order of n, denoted as s^2^2(p)∧ p≺ n, where n is the sample size, one can detect the existence of signals if and only if gSNR≻p^1/2/n∧s(p)/n. Furthermore, if the noise is additive (i.e., y=f(β^τx)+ϵ), one can detect the existence of the signal if and only if gSNR≻p^1/2/n∧s(p)/n∧1/√(n). It is rather surprising that the detection boundary for the single index model with additive noise matches that for linear regression models. These results pave the road for thorough theoretical analysis of single/multiple index models in high dimensions.


The All-or-Nothing Phenomenon in Sparse Linear Regression

We study the problem of recovering a hidden binary k-sparse p-dimensiona...

Probabilistic index maps for modeling natural signals

One of the major problems in modeling natural signals is that signals wi...

Entrywise Estimation of Singular Vectors of Low-Rank Matrices with Heteroskedasticity and Dependence

We propose an estimator for the singular vectors of high-dimensional low...

Residual Ratio Thresholding for Model Order Selection

Model order selection (MOS) in linear regression models is a widely stud...

The All-or-Nothing Phenomenon in Sparse Tensor PCA

We study the statistical problem of estimating a rank-one sparse tensor ...

High Dimensional Linear Regression using Lattice Basis Reduction

We consider a high dimensional linear regression problem where the goal ...

Signed Support Recovery for Single Index Models in High-Dimensions

In this paper we study the support recovery problem for single index mod...