Learning Consistent Deep Generative Models from Sparse Data via Prediction Constraints

12/12/2020
by   Gabriel Hope, et al.
0

We develop a new framework for learning variational autoencoders and other deep generative models that balances generative and discriminative goals. Our framework optimizes model parameters to maximize a variational lower bound on the likelihood of observed data, subject to a task-specific prediction constraint that prevents model misspecification from leading to inaccurate predictions. We further enforce a consistency constraint, derived naturally from the generative model, that requires predictions on reconstructed data to match those on the original data. We show that these two contributions – prediction constraints and consistency constraints – lead to promising image classification performance, especially in the semi-supervised scenario where category labels are sparse but unlabeled data is plentiful. Our approach enables advances in generative modeling to directly boost semi-supervised classification performance, an ability we demonstrate by augmenting deep generative models with latent variables capturing spatial transformations.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 9

page 15

08/21/2016

Inverting Variational Autoencoders for Improved Generative Accuracy

Recent advances in semi-supervised learning with deep generative models ...
11/22/2016

Max-Margin Deep Generative Models for (Semi-)Supervised Learning

Deep generative models (DGMs) are effective on learning multilayered rep...
03/11/2019

Deep Generative Models: Deterministic Prediction with an Application in Inverse Rendering

Deep generative models are stochastic neural networks capable of learnin...
05/11/2019

Boosting Generative Models by Leveraging Cascaded Meta-Models

Deep generative models are effective methods of modeling data. However, ...
10/29/2018

Semi-unsupervised Learning of Human Activity using Deep Generative Models

Here we demonstrate a new deep generative model for classification. We i...
10/29/2018

Semi-crowdsourced Clustering with Deep Generative Models

We consider the semi-supervised clustering problem where crowdsourcing p...
02/24/2016

Learning to Generate with Memory

Memory units have been widely used to enrich the capabilities of deep ne...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.