Gaussian linear model selection in a dependent context

05/03/2020
by   Emmanuel Caron, et al.
0

In this paper, we study the nonparametric linear model, when the error process is a dependent Gaussian process. We focus on the estimation of the mean vector via a model selection approach. We first give the general theoretical form of the penalty function, ensuring that the penalized estimator among a collection of models satisfies an oracle inequality. Then we derive a penalty shape involving the spectral radius of the covariance matrix of the errors, which can be chosen proportional to the dimension when the error process is stationary and short range dependent. However, this penalty can be too rough in some cases, in particular when the error process is long range dependent. In a second part, we focus on the fixed-design regression model assuming that the error process is a stationary Gaussian process. We propose a model selection procedure in order to estimate the mean function via piecewise polynomials on a regular partition, when the error process is either short range dependent, long range dependent or anti-persistent. We present different kinds of penalties, depending on the memory of the process. For each case, an adaptive estimator is built, and the rates of convergence are computed. Thanks to several sets of simulations, we study the performance of these different penalties for all types of errors (short memory, long memory and anti-persistent errors). Finally, we give an application of our method to the well-known Nile data, which clearly shows that the type of dependence of the error process must be taken into account.

READ FULL TEXT

page 13

page 15

page 16

page 17

page 18

page 20

research
06/13/2018

Asymptotic distribution of least square estimators for linear models with dependent errors

In this paper, we consider the usual linear regression model in the case...
research
10/16/2017

Asymptotic distribution of least square estimators for linear models with dependent errors : regular designs

In this paper, we consider the usual linear regression model in the case...
research
05/22/2022

Adaptive estimation for the nonparametric bivariate additive model in random design with long-memory dependent errors

We investigate the nonparametric bivariate additive regression estimatio...
research
11/11/2018

Adaptive model selection method for a conditionally Gaussian semimartingale regression in continuous time

This paper considers the problem of robust adaptive efficient estimating...
research
06/27/2019

The exact form of the 'Ockham factor' in model selection

We unify the Bayesian and Frequentist justifications for model selection...
research
03/23/2020

On bandwidth selection problems in nonparametric trend estimation under martingale difference errors

In this paper, we are interested in the problem of smoothing parameter s...
research
06/15/2019

Linear regression with stationary errors : the R package slm

This paper introduces the R package slm which stands for Stationary Line...

Please sign up or login with your details

Forgot password? Click here to reset