Probabilistic Reduced-Dimensional Vector Autoregressive Modeling for Dynamics Prediction and Reconstruction with Oblique Projections

09/03/2023

∙

In this paper, we propose a probabilistic reduced-dimensional vector autoregressive (PredVAR) model with oblique projections. This model partitions the measurement space into a dynamic subspace and a static subspace that do not need to be orthogonal. The partition allows us to apply an oblique projection to extract dynamic latent variables (DLVs) from high-dimensional data with maximized predictability. We develop an alternating iterative PredVAR algorithm that exploits the interaction between updating the latent VAR dynamics and estimating the oblique projection, using expectation maximization (EM) and a statistical constraint. In addition, the noise covariance matrices are estimated as a natural outcome of the EM method. A simulation case study of the nonlinear Lorenz oscillation system illustrates the advantages of the proposed approach over two alternatives.

READ FULL TEXT

Probabilistic Reduced-Dimensional Vector Autoregressive Modeling for Dynamics Prediction and Reconstruction with Oblique Projections

Normal Inverse Gaussian Autoregressive Model Using EM Algorithm

Alternating projections with applications to Gerchberg-Saxton error reduction

A Graphical Model for Fusing Diverse Microbiome Data

Probabilistic Unrolling: Scalable, Inverse-Free Maximum Likelihood Estimation for Latent Gaussian Models

High-Dimensional Regression with Gaussian Mixtures and Partially-Latent Response Variables

A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering

Dynamic probabilistic predictable feature analysis for high dimensional temporal monitoring

Probabilistic Reduced-Dimensional Vector Autoregressive Modeling for Dynamics Prediction and Reconstruction with Oblique Projections

Related Research

Normal Inverse Gaussian Autoregressive Model Using EM Algorithm

Alternating projections with applications to Gerchberg-Saxton error reduction

A Graphical Model for Fusing Diverse Microbiome Data

Probabilistic Unrolling: Scalable, Inverse-Free Maximum Likelihood Estimation for Latent Gaussian Models

High-Dimensional Regression with Gaussian Mixtures and Partially-Latent Response Variables

A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering

Dynamic probabilistic predictable feature analysis for high dimensional temporal monitoring