A General Method for Amortizing Variational Filtering

11/13/2018
by   Joseph Marino, et al.
12

We introduce the variational filtering EM algorithm, a simple, general-purpose method for performing variational inference in dynamical latent variable models using information from only past and present variables, i.e. filtering. The algorithm is derived from the variational objective in the filtering setting and consists of an optimization procedure at each time step. By performing each inference optimization procedure with an iterative amortized inference model, we obtain a computationally efficient implementation of the algorithm, which we call amortized variational filtering. We present experiments demonstrating that this general-purpose method improves performance across several deep dynamical latent variable models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2022

Training Latent Variable Models with Auto-encoding Variational Bayes: A Tutorial

Auto-encoding Variational Bayes (AEVB) is a powerful and general algorit...
research
07/24/2018

Iterative Amortized Inference

Inference models are a key component in scaling variational inference to...
research
11/01/2017

An Information-Theoretic Analysis of Deep Latent-Variable Models

We present an information-theoretic framework for understanding trade-of...
research
11/25/2021

Variational Gibbs inference for statistical model estimation from incomplete data

Statistical models are central to machine learning with broad applicabil...
research
09/21/2017

SpectralFPL: Online Spectral Learning for Single Topic Models

This paper studies how to efficiently learn an optimal latent variable m...
research
12/21/2017

Truncated Variational Sampling for "Black Box" Optimization of Generative Models

We investigate the optimization of two generative models with binary hid...
research
06/01/2023

Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains

Latent Gaussian process (GP) models are widely used in neuroscience to u...

Please sign up or login with your details

Forgot password? Click here to reset