A Unified Approach to Variational Autoencoders and Stochastic Normalizing Flows via Markov Chains

11/24/2021
by   Johannes Hertrich, et al.
0

Normalizing flows, diffusion normalizing flows and variational autoencoders are powerful generative models. In this paper, we provide a unified framework to handle these approaches via Markov chains. Indeed, we consider stochastic normalizing flows as pair of Markov chains fulfilling some properties and show that many state-of-the-art models for data generation fit into this framework. The Markov chains point of view enables us to couple both deterministic layers as invertible neural networks and stochastic layers as Metropolis-Hasting layers, Langevin layers and variational autoencoders in a mathematically sound way. Besides layers with densities as Langevin layers, diffusion layers or variational autoencoders, also layers having no densities as deterministic layers or Metropolis-Hasting layers can be handled. Hence our framework establishes a useful mathematical tool to combine the various approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2021

Stochastic Normalizing Flows for Inverse Problems: a Markov Chains Viewpoint

To overcome topological constraints and improve the expressiveness of no...
research
07/06/2020

SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flows

Normalizing flows and variational autoencoders are powerful generative m...
research
02/06/2016

Ladder Variational Autoencoders

Variational Autoencoders are powerful models for unsupervised learning. ...
research
03/20/2018

Linearizing Visual Processes with Convolutional Variational Autoencoders

This work studies the problem of modeling non-linear visual processes by...
research
09/06/2018

Reversible Markov chains: variational representations and ordering

This pedagogical document explains three variational representations tha...
research
11/01/2019

Variational Autoencoders for Generative Modelling of Water Cherenkov Detectors

Matter-antimatter asymmetry is one of the major unsolved problems in phy...
research
06/02/2023

Generative Autoencoders as Watermark Attackers: Analyses of Vulnerabilities and Threats

Invisible watermarks safeguard images' copyrights by embedding hidden me...

Please sign up or login with your details

Forgot password? Click here to reset