Non-parametric sparse additive auto-regressive network models

01/23/2018
by   Hao Zhou, et al.
0

Consider a multi-variate time series (X_t)_t=0^T where X_t ∈R^d which may represent spike train responses for multiple neurons in a brain, crime event data across multiple regions, and many others. An important challenge associated with these time series models is to estimate an influence network between the d variables, especially when the number of variables d is large meaning we are in the high-dimensional setting. Prior work has focused on parametric vector auto-regressive models. However, parametric approaches are somewhat restrictive in practice. In this paper, we use the non-parametric sparse additive model (SpAM) framework to address this challenge. Using a combination of β and ϕ-mixing properties of Markov chains and empirical process techniques for reproducing kernel Hilbert spaces (RKHSs), we provide upper bounds on mean-squared error in terms of the sparsity s, logarithm of the dimension d, number of time points T, and the smoothness of the RKHSs. Our rates are sharp up to logarithm factors in many cases. We also provide numerical experiments that support our theoretical results and display potential advantages of using our non-parametric SpAM framework for a Chicago crime dataset.

READ FULL TEXT

page 21

page 22

research
06/15/2013

Early stopping and non-parametric regression: An optimal data-dependent stopping rule

The strategy of early stopping is a regularization technique based on ch...
research
01/25/2015

Randomized sketches for kernels: Fast and optimal non-parametric regression

Kernel ridge regression (KRR) is a standard method for performing non-pa...
research
06/28/2021

Improved Prediction and Network Estimation Using the Monotone Single Index Multi-variate Autoregressive Model

Network estimation from multi-variate point process or time series data ...
research
06/18/2012

Group Sparse Additive Models

We consider the problem of sparse variable selection in nonparametric ad...
research
06/14/2017

Information Potential Auto-Encoders

In this paper, we suggest a framework to make use of mutual information ...
research
12/11/2020

Online Coresets for Clustering with Bregman Divergences

We present algorithms that create coresets in an online setting for clus...
research
02/07/2022

Effects of Parametric and Non-Parametric Methods on High Dimensional Sparse Matrix Representations

The semantics are derived from textual data that provide representations...

Please sign up or login with your details

Forgot password? Click here to reset