Bayesian Inference in High-Dimensional Time-Serieswith the Orthogonal Stochastic Linear Mixing Model

06/25/2021
by   Rui Meng, et al.
0

Many modern time-series datasets contain large numbers of output response variables sampled for prolonged periods of time. For example, in neuroscience, the activities of 100s-1000's of neurons are recorded during behaviors and in response to sensory stimuli. Multi-output Gaussian process models leverage the nonparametric nature of Gaussian processes to capture structure across multiple outputs. However, this class of models typically assumes that the correlations between the output response variables are invariant in the input space. Stochastic linear mixing models (SLMM) assume the mixture coefficients depend on input, making them more flexible and effective to capture complex output dependence. However, currently, the inference for SLMMs is intractable for large datasets, making them inapplicable to several modern time-series problems. In this paper, we propose a new regression framework, the orthogonal stochastic linear mixing model (OSLMM) that introduces an orthogonal constraint amongst the mixing coefficients. This constraint reduces the computational burden of inference while retaining the capability to handle complex output dependence. We provide Markov chain Monte Carlo inference procedures for both SLMM and OSLMM and demonstrate superior model scalability and reduced prediction error of OSLMM compared with state-of-the-art methods on several real-world applications. In neurophysiology recordings, we use the inferred latent functions for compact visualization of population responses to auditory stimuli, and demonstrate superior results compared to a competing method (GPFA). Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale time-series datasets.

READ FULL TEXT
research
08/12/2019

Mixture-based Multiple Imputation Models for Clinical Data with a Temporal Dimension

The problem of missing values in multivariable time series is a key chal...
research
08/12/2019

Mixture-based Multiple Imputation Model for Clinical Data with a Temporal Dimension

The problem of missing values in multivariable time series is a key chal...
research
10/19/2011

Gaussian Process Regression Networks

We introduce a new regression framework, Gaussian process regression net...
research
02/26/2018

Partial Distance Correlation Screening for High Dimensional Time Series

High dimensional time series datasets are becoming increasingly common i...
research
11/14/2019

Scalable Exact Inference in Multi-Output Gaussian Processes

Multi-output Gaussian processes (MOGPs) leverage the flexibility and int...
research
02/09/2022

Adapting to Mixing Time in Stochastic Optimization with Markovian Data

We consider stochastic optimization problems where data is drawn from a ...
research
12/09/2019

Basis Prediction Networks for Effective Burst Denoising with Large Kernels

Bursts of images exhibit significant self-similarity across both time an...

Please sign up or login with your details

Forgot password? Click here to reset