Asymptotic normality in linear regression with approximately sparse structure

03/08/2022
by   Saulius Jokubaitis, et al.
0

In this paper we study the asymptotic normality in high-dimensional linear regression. We focus on the case where the covariance matrix of the regression variables has a KMS structure, in asymptotic settings where the number of predictors, p, is proportional to the number of observations, n. The main result of the paper is the derivation of the exact asymptotic distribution for the suitably centered and normalized squared norm of the product between predictor matrix, 𝕏, and outcome variable, Y, i.e. the statistic 𝕏'Y_2^2. Additionally, we consider a specific case of approximate sparsity of the model parameter vector β and perform a Monte-Carlo simulation study. The simulation results suggest that the statistic approaches the limiting distribution fairly quickly even under high variable multi-correlation and relatively small number of observations, suggesting possible applications to the construction of statistical testing procedures for the real-world data and related problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2022

Testing Heteroskedasticity in High-Dimensional Linear Regression

We propose a new testing procedure of heteroskedasticity in high-dimensi...
research
07/11/2019

Directing Power Towards Subspaces of the Alternative Hypothesis

This paper treats two problems in high-dimensional testing that have rec...
research
09/28/2020

Some exact results for the statistical physics problem of high-dimensional linear regression

High-dimensional linear regression have become recently a subject of man...
research
08/31/2020

Discrete convolution statistic for hypothesis testing

The question of testing for equality in distribution between two linear ...
research
03/14/2022

The TAP free energy for high-dimensional linear regression

We derive a variational representation for the log-normalizing constant ...
research
09/11/2018

T-statistic for Autoregressive process

In this paper, we discuss the distribution of the t-statistic under the ...
research
09/03/2022

Forbidden Knowledge and Specialized Training: A Versatile Solution for the Two Main Sources of Overfitting in Linear Regression

Overfitting in linear regression is broken down into two main causes. Fi...

Please sign up or login with your details

Forgot password? Click here to reset