DeepAI AI Chat
Log In Sign Up

Conditional Inference in Pre-trained Variational Autoencoders via Cross-coding

05/20/2018
by   Ga Wu, et al.
0

Variational Autoencoders (VAEs) are a popular generative model, but one in which conditional inference can be challenging. If the decomposition into query and evidence variables is fixed, conditional VAEs provide an attractive solution. To support arbitrary queries, one is generally reduced to Markov Chain Monte Carlo sampling methods that can suffer from long mixing times. In this paper, we propose an idea we term cross-coding to approximate the distribution over the latent variables after conditioning on an evidence assignment to some subset of the variables. This allows generating query samples without retraining the full VAE. We experimentally evaluate three variations of cross-coding showing that (i) two can be quickly trained for different decompositions of evidence and query and (ii) they quantitatively and qualitatively outperform Hamiltonian Monte Carlo.

READ FULL TEXT

page 6

page 8

page 12

10/28/2016

Improving Sampling from Generative Autoencoders with Markov Chains

We focus on generative autoencoders, such as variational or adversarial ...
09/26/2022

Hamiltonian Monte Carlo for efficient Gaussian sampling: long and random steps

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling f...
03/17/2021

Invertible Flow Non Equilibrium sampling

Simultaneously sampling from a complex distribution with intractable nor...
09/02/2020

Quasi-symplectic Langevin Variational Autoencoder

Variational autoencoder (VAE) as one of the well investigated generative...
11/25/2017

Generalizing Hamiltonian Monte Carlo with Neural Networks

We present a general-purpose method to train Markov chain Monte Carlo ke...
03/24/2014

Adaptive MCMC-Based Inference in Probabilistic Logic Programs

Probabilistic Logic Programming (PLP) languages enable programmers to sp...
11/25/2022

Toward Unlimited Self-Learning Monte Carlo with Annealing Process Using VAE's Implicit Isometricity

Self-learning Monte Carlo (SLMC) methods are recently proposed to accele...

Code Repositories

XCoder_VAE_Conditional_Inference

None


view repo