DeepAI AI Chat
Log In Sign Up

High-Dimensional Bernoulli Autoregressive Process with Long-Range Dependence

by   Parthe Pandit, et al.

We consider the problem of estimating the parameters of a multivariate Bernoulli process with auto-regressive feedback in the high-dimensional setting where the number of samples available is much less than the number of parameters. This problem arises in learning interconnections of networks of dynamical systems with spiking or binary-valued data. We allow the process to depend on its past up to a lag p, for a general p > 1, allowing for more realistic modeling in many applications. We propose and analyze an ℓ_1-regularized maximum likelihood estimator (MLE) under the assumption that the parameter tensor is approximately sparse. Rigorous analysis of such estimators is made challenging by the dependent and non-Gaussian nature of the process as well as the presence of the nonlinearities and multi-level feedback. We derive precise upper bounds on the mean-squared estimation error in terms of the number of samples, dimensions of the process, the lag p and other key statistical properties of the model. The ideas presented can be used in the high-dimensional analysis of regularized M-estimators for other sparse nonlinear and non-Gaussian processes with long-range dependence.


The Impact of Regularization on High-dimensional Logistic Regression

Logistic regression is commonly used for modeling dichotomous outcomes. ...

Improved Estimation of High-dimensional Ising Models

We consider the problem of jointly estimating the parameters as well as ...

Learning Partially Observed Linear Dynamical Systems from Logarithmic Number of Samples

In this work, we study the problem of learning partially observed linear...

Impulse Response Analysis for Sparse High-Dimensional Time Series

We consider structural impulse response analysis for sparse high-dimensi...

Probabilistic properties of detrended fluctuation analysis for Gaussian processes

The detrended fluctuation analysis (DFA) is one of the most widely used ...

Regularized Estimation of High-Dimensional Vector AutoRegressions with Weakly Dependent Innovations

There has been considerable advance in understanding the properties of s...

Compact Autoregressive Network

Autoregressive networks can achieve promising performance in many sequen...