Spectral learning of Bernoulli linear dynamical systems models for decision-making

03/03/2023
by   Iris R. Stone, et al.
0

Latent linear dynamical systems with Bernoulli observations provide a powerful modeling framework for identifying the temporal dynamics underlying binary time series data, which arise in a variety of contexts such as binary decision-making and discrete stochastic processes such as binned neural spike trains. Here, we develop a spectral learning method for fast, efficient fitting of Bernoulli latent linear dynamical system (LDS) models. Our approach extends traditional subspace identification methods to the Bernoulli setting via a transformation of the first and second sample moments. This results in a robust, fixed-cost estimator that avoids the hazards of local optima and the long computation time of iterative fitting procedures like the expectation-maximization (EM) algorithm. In regimes where data is limited or assumptions about the statistical structure of the data are not met, we demonstrate that the spectral estimate provides a good initialization for Laplace-EM fitting. Finally, we show that the estimator provides substantial benefits to real world settings by analyzing data from mice performing a sensory decision-making task.

READ FULL TEXT

page 8

page 12

page 19

research
02/12/2018

Spectral Filtering for General Linear Dynamical Systems

We give a polynomial-time algorithm for learning latent-state linear dyn...
research
07/04/2012

Predictive Linear-Gaussian Models of Stochastic Dynamical Systems

Models of dynamical systems based on predictive state representations (P...
research
10/04/2018

Convergence of the Expectation-Maximization Algorithm Through Discrete-Time Lyapunov Stability Theory

In this paper, we propose a dynamical systems perspective of the Expecta...
research
01/13/2020

Unifying and generalizing models of neural dynamics during decision-making

An open question in systems and computational neuroscience is how neural...
research
05/25/2023

Koopman Kernel Regression

Many machine learning approaches for decision making, such as reinforcem...
research
08/02/2019

Linear Dynamics: Clustering without identification

Clustering time series is a delicate task; varying lengths and temporal ...
research
08/21/2021

Using growth transform dynamical systems for spatio-temporal data sonification

Sonification, or encoding information in meaningful audio signatures, ha...

Please sign up or login with your details

Forgot password? Click here to reset