DeepAI AI Chat
Log In Sign Up

TzK Flow - Conditional Generative Model

11/05/2018
by   Micha Livne, et al.
UNIVERSITY OF TORONTO
0

We introduce TzK (pronounced "task"), a conditional flow-based encoder/decoder generative model, formulated in terms of maximum likelihood (ML). TzK offers efficient approximation of arbitrary data sample distributions (similar to GAN and flow-based ML), and stable training (similar to VAE and ML), while avoiding variational approximations (similar to ML). TzK exploits meta-data to facilitate a bottleneck, similar to autoencoders, thereby producing a low-dimensional representation. Unlike autoencoders, our bottleneck does not limit model expressiveness, similar to flow-based ML. Supervised, unsupervised, and semi-supervised learning are supported by replacing missing observations with samples from learned priors. We demonstrate TzK by jointly training on MNIST and Omniglot with minimal preprocessing, and weak supervision, with results which are comparable to state-of-the-art.

READ FULL TEXT

page 3

page 5

05/19/2022

Closing the gap: Exact maximum likelihood training of generative autoencoders using invertible layers

In this work, we provide an exact likelihood alternative to the variatio...
05/27/2020

Semi-supervised source localization with deep generative modeling

We develop a semi-supervised learning (SSL) approach for acoustic source...
06/30/2022

Optimizing Training Trajectories in Variational Autoencoders via Latent Bayesian Optimization Approach

Unsupervised and semi-supervised ML methods such as variational autoenco...
02/20/2020

Regularized Autoencoders via Relaxed Injective Probability Flow

Invertible flow-based generative models are an effective method for lear...
10/04/2019

Conditional out-of-sample generation for unpaired data using trVAE

While generative models have shown great success in generating high-dime...
10/13/2021

The deep generative decoder: Using MAP estimates of representations

A deep generative model is characterized by a representation space, its ...
02/18/2021

VAE Approximation Error: ELBO and Conditional Independence

The importance of Variational Autoencoders reaches far beyond standalone...