Finite impulse response models: A non-asymptotic analysis of the least squares estimator

11/28/2019
by   Boualem Djehiche, et al.
0

We consider a finite impulse response system with centered independent sub-Gaussian design covariates and noise components that are not necessarily identically distributed. We derive non-asymptotic near-optimal estimation and prediction bounds for the least-squares estimator of the parameters. Our results are based on two concentration inequalities on the norm of sums of dependent covariate vectors and on the singular values of their covariance operator that are of independent value on their own and where the dependence arises from the time shift structure of the time series. These results generalize the known bounds for the independent case.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2023

Statistically Optimal Robust Mean and Covariance Estimation for Anisotropic Gaussians

Assume that X_1, …, X_N is an ε-contaminated sample of N independent Gau...
research
10/12/2018

Finite sample performance of linear least squares estimation

Linear Least Squares is a very well known technique for parameter estima...
research
12/17/2019

A Finite-Sample Deviation Bound for Stable Autoregressive Processes

In this paper, we study non-asymptotic deviation bounds of the least squ...
research
02/04/2021

Sharper Sub-Weibull Concentrations: Non-asymptotic Bai-Yin Theorem

Arising in high-dimensional probability, non-asymptotic concentration in...
research
07/24/2023

Tuning-free one-bit covariance estimation using data-driven dithering

We consider covariance estimation of any subgaussian distribution from f...
research
06/13/2011

Random design analysis of ridge regression

This work gives a simultaneous analysis of both the ordinary least squar...
research
03/17/2020

Finite-time Identification of Stable Linear Systems: Optimality of the Least-Squares Estimator

We provide a new finite-time analysis of the estimation error of stable ...

Please sign up or login with your details

Forgot password? Click here to reset