Adversarial Variational Embedding for Robust Semi-supervised Learning

05/07/2019
by   Xiang Zhang, et al.
0

Semi-supervised learning is sought for leveraging the unlabelled data when labelled data is difficult or expensive to acquire. Deep generative models (e.g., Variational Autoencoder (VAE)) and semisupervised Generative Adversarial Networks (GANs) have recently shown promising performance in semi-supervised classification for the excellent discriminative representing ability. However, the latent code learned by the traditional VAE is not exclusive (repeatable) for a specific input sample, which prevents it from excellent classification performance. In particular, the learned latent representation depends on a non-exclusive component which is stochastically sampled from the prior distribution. Moreover, the semi-supervised GAN models generate data from pre-defined distribution (e.g., Gaussian noises) which is independent of the input data distribution and may obstruct the convergence and is difficult to control the distribution of the generated data. To address the aforementioned issues, we propose a novel Adversarial Variational Embedding (AVAE) framework for robust and effective semi-supervised learning to leverage both the advantage of GAN as a high quality generative model and VAE as a posterior distribution learner. The proposed approach first produces an exclusive latent code by the model which we call VAE++, and meanwhile, provides a meaningful prior distribution for the generator of GAN. The proposed approach is evaluated over four different real-world applications and we show that our method outperforms the state-of-the-art models, which confirms that the combination of VAE++ and GAN can provide significant improvements in semisupervised classification.

READ FULL TEXT
research
12/26/2020

EC-GAN: Low-Sample Classification using Semi-Supervised Algorithms and GANs

Semi-supervised learning has been gaining attention as it allows for per...
research
10/24/2018

Semi-supervised Target-level Sentiment Analysis via Variational Autoencoder

Target-level aspect-based sentiment analysis (TABSA) is a long-standing ...
research
12/17/2019

Progressive VAE Training on Highly Sparse and Imbalanced Data

In this paper, we present a novel approach for training a Variational Au...
research
07/19/2018

Doubly Stochastic Adversarial Autoencoder

Any autoencoder network can be turned into a generative model by imposin...
research
02/18/2021

VAE Approximation Error: ELBO and Conditional Independence

The importance of Variational Autoencoders reaches far beyond standalone...
research
11/17/2020

Semi-supervised Learning of Galaxy Morphology using Equivariant Transformer Variational Autoencoders

The growth in the number of galaxy images is much faster than the speed ...

Please sign up or login with your details

Forgot password? Click here to reset