Sparse, Low-bias, and Scalable Estimation of High Dimensional Vector Autoregressive Models via Union of Intersections

08/29/2019
by   Trevor Ruiz, et al.
0

Vector autoregressive (VAR) models are widely used for causal discovery and forecasting in multivariate time series analyses in fields as diverse as neuroscience, environmental science, and econometrics. In the high-dimensional setting, model parameters are typically estimated by L1-regularized maximum likelihood; yet, when applied to VAR models, this technique produces a sizable trade-off between sparsity and bias with the choice of the regularization hyperparameter, and thus between causal discovery and prediction. That is, low-bias estimation entails dense parameter selection, and sparse selection entails increased bias; the former is useful in forecasting but less likely to yield scientific insight leading to discovery of causal influences, and conversely for the latter. This paper presents a scalable algorithm for simultaneous low-bias and low-variance estimation (hence good prediction) with sparse selection for high-dimensional VAR models. The method leverages the recently developed Union of Intersections (UoI) algorithmic framework for flexible, modular, and scalable feature selection and estimation that allows control of false discovery and false omission in feature selection while maintaining low bias and low variance. This paper demonstrates the superior performance of the UoI-VAR algorithm compared with other methods in simulation studies, exhibits its application in data analysis, and illustrates its good algorithmic scalability in multi-node distributed memory implementations.

READ FULL TEXT

page 19

page 21

research
02/28/2020

Causality and Robust Optimization

A decision-maker must consider cofounding bias when attempting to apply ...
research
05/22/2017

Union of Intersections (UoI) for Interpretable Data Driven Discovery and Prediction

The increasing size and complexity of scientific data could dramatically...
research
01/06/2022

Sparsity-based Feature Selection for Anomalous Subgroup Discovery

Anomalous pattern detection aims to identify instances where deviation f...
research
12/17/2014

Hierarchical Vector Autoregression

Vector autoregression (VAR) is a fundamental tool for modeling the joint...
research
09/02/2022

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

As a special infinite-order vector autoregressive (VAR) model, the vecto...
research
06/09/2022

On the Bias-Variance Characteristics of LIME and SHAP in High Sparsity Movie Recommendation Explanation Tasks

We evaluate two popular local explainability techniques, LIME and SHAP, ...

Please sign up or login with your details

Forgot password? Click here to reset