Inference of High-dimensional Autoregressive Generalized Linear Models

05/09/2016
by   Eric C. Hall, et al.
0

Vector autoregressive models characterize a variety of time series in which linear combinations of current and past observations can be used to accurately predict future observations. For instance, each element of an observation vector could correspond to a different node in a network, and the parameters of an autoregressive model would correspond to the impact of the network structure on the time series evolution. Often these models are used successfully in practice to learn the structure of social, epidemiological, financial, or biological neural networks. However, little is known about statistical guarantees on estimates of such models in non-Gaussian settings. This paper addresses the inference of the autoregressive parameters and associated network structure within a generalized linear model framework that includes Poisson and Bernoulli autoregressive processes. At the heart of this analysis is a sparsity-regularized maximum likelihood estimator. While sparsity-regularization is well-studied in the statistics and machine learning communities, those analysis methods cannot be applied to autoregressive generalized linear models because of the correlations and potential heteroscedasticity inherent in the observations. Sample complexity bounds are derived using a combination of martingale concentration inequalities and modern empirical process techniques for dependent random variables. These bounds, which are supported by several simulation studies, characterize the impact of various network parameters on estimator performance.

READ FULL TEXT
research
05/12/2021

Generalized Autoregressive Moving Average Models with GARCH Errors

One of the important and widely used classes of models for non-Gaussian ...
research
02/13/2020

Generalized Autoregressive Neural Network Models

A time series is a sequence of observations taken sequentially in time. ...
research
05/29/2022

Network Vector Autoregressive Model for Dyadic Response Variables

For general panel data, by introducing network structure, network vector...
research
09/02/2022

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

As a special infinite-order vector autoregressive (VAR) model, the vecto...
research
07/10/2020

Community Network Auto-Regression for High-Dimensional Time Series

Modeling responses on the nodes of a large-scale network is an important...
research
03/16/2020

Context-dependent self-exciting point processes: models, methods, and risk bounds in high dimensions

High-dimensional autoregressive point processes model how current events...
research
02/13/2018

Network Estimation from Point Process Data

Consider observing a collection of discrete events within a network that...

Please sign up or login with your details

Forgot password? Click here to reset