Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

05/20/2016
by   Maximilian Karl, et al.
0

We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle highly nonlinear input data with temporal and spatial dependencies such as image sequences without domain knowledge. Our experiments show that enabling backpropagation through transitions enforces state space assumptions and significantly improves information content of the latent embedding. This also enables realistic long-term prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/04/2022

Linear Variational State Space Filtering

We introduce Variational State-Space Filters (VSSF), a new method for un...
research
06/23/2021

A Note on the Accuracy of Variational Bayes in State Space Models: Inference and Prediction

Using theoretical and numerical results, we document the accuracy of com...
research
10/14/2019

Variational Tracking and Prediction with Generative Disentangled State-Space Models

We address tracking and prediction of multiple moving objects in visual ...
research
07/12/2022

Unsupervised learning of observation functions in state-space models by nonparametric moment methods

We investigate the unsupervised learning of non-invertible observation f...
research
02/07/2020

Constructing a variational family for nonlinear state-space models

We consider the problem of maximum likelihood parameter estimation for n...
research
06/12/2018

Deep State Space Models for Unconditional Word Generation

Autoregressive feedback is considered a necessity for successful uncondi...
research
10/02/2019

Variational Temporal Abstraction

We introduce a variational approach to learning and inference of tempora...

Please sign up or login with your details

Forgot password? Click here to reset