Model selection for high-dimensional linear regression with dependent observations

06/18/2019
by   Ching-Kang Ing, et al.
0

We investigate the prediction capability of the orthogonal greedy algorithm (OGA) in high-dimensional regression models with dependent observations. The rates of convergence of the prediction error of OGA are obtained under a variety of sparsity conditions. To prevent OGA from overfitting, we introduce a high-dimensional Akaike's information criterion (HDAIC) to determine the number of OGA iterations. A key contribution of this work is to show that OGA, used in conjunction with HDAIC, can achieve the optimal convergence rate without knowledge of how sparse the underlying high-dimensional model is.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2019

High-dimensional variable selection via low-dimensional adaptive learning

A stochastic search method, the so-called Adaptive Subspace (AdaSub) met...
research
10/30/2022

Prediction Sets for High-Dimensional Mixture of Experts Models

Large datasets make it possible to build predictive models that can capt...
research
02/03/2017

Sharp Convergence Rates for Forward Regression in High-Dimensional Sparse Linear Models

Forward regression is a statistical model selection and estimation proce...
research
11/03/2016

High-dimensional regression over disease subgroups

We consider high-dimensional regression over subgroups of observations. ...
research
04/18/2022

Benign Overfitting in Time Series Linear Model with Over-Parameterization

The success of large-scale models in recent years has increased the impo...
research
01/29/2018

Model selection in sparse high-dimensional vine copula models with application to portfolio risk

Vine copulas allow to build flexible dependence models for an arbitrary ...
research
01/23/2017

Iterative Thresholding for Demixing Structured Superpositions in High Dimensions

We consider the demixing problem of two (or more) high-dimensional vecto...

Please sign up or login with your details

Forgot password? Click here to reset