Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains

06/01/2023
by   Matthew Dowling, et al.
0

Latent Gaussian process (GP) models are widely used in neuroscience to uncover hidden state evolutions from sequential observations, mainly in neural activity recordings. While latent GP models provide a principled and powerful solution in theory, the intractable posterior in non-conjugate settings necessitates approximate inference schemes, which may lack scalability. In this work, we propose cvHM, a general inference framework for latent GP models leveraging Hida-Matérn kernels and conjugate computation variational inference (CVI). With cvHM, we are able to perform variational inference of latent neural trajectories with linear time complexity for arbitrary likelihoods. The reparameterization of stationary kernels using Hida-Matérn GPs helps us connect the latent variable models that encode prior assumptions through dynamical systems to those that encode trajectory assumptions through GPs. In contrast to previous work, we use bidirectional information filtering, leading to a more concise implementation. Furthermore, we employ the Whittle approximate likelihood to achieve highly efficient hyperparameter learning.

READ FULL TEXT

page 4

page 6

page 8

page 17

page 21

page 24

page 25

research
11/05/2019

GP-ALPS: Automatic Latent Process Selection for Multi-Output Gaussian Process Models

A simple and widely adopted approach to extend Gaussian processes (GPs) ...
research
02/06/2014

Distributed Variational Inference in Sparse Gaussian Process Regression and Latent Variable Models

Gaussian processes (GPs) are a powerful tool for probabilistic inference...
research
07/09/2020

Fast Variational Learning in State-Space Gaussian Process Models

Gaussian process (GP) regression with 1D inputs can often be performed i...
research
10/07/2022

Latent Neural ODEs with Sparse Bayesian Multiple Shooting

Training dynamic models, such as neural ODEs, on long trajectories is a ...
research
05/10/2015

Spike and Slab Gaussian Process Latent Variable Models

The Gaussian process latent variable model (GP-LVM) is a popular approac...
research
11/13/2018

A General Method for Amortizing Variational Filtering

We introduce the variational filtering EM algorithm, a simple, general-p...
research
05/18/2020

Deep Latent-Variable Kernel Learning

Deep kernel learning (DKL) leverages the connection between Gaussian pro...

Please sign up or login with your details

Forgot password? Click here to reset