AVAE: Adversarial Variational Auto Encoder

12/21/2020
by   Antoine Plumerault, et al.
0

Among the wide variety of image generative models, two models stand out: Variational Auto Encoders (VAE) and Generative Adversarial Networks (GAN). GANs can produce realistic images, but they suffer from mode collapse and do not provide simple ways to get the latent representation of an image. On the other hand, VAEs do not have these problems, but they often generate images less realistic than GANs. In this article, we explain that this lack of realism is partially due to a common underestimation of the natural image manifold dimensionality. To solve this issue we introduce a new framework that combines VAE and GAN in a novel and complementary way to produce an auto-encoding model that keeps VAEs properties while generating images of GAN-quality. We evaluate our approach both qualitatively and quantitatively on five image datasets.

READ FULL TEXT

page 14

page 15

page 16

research
01/17/2017

Image Generation and Editing with Variational Info Generative AdversarialNetworks

Recently there has been an enormous interest in generative models for im...
research
08/07/2019

Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networks

As deep learning is showing unprecedented success in medical image analy...
research
11/14/2017

Conditional Autoencoders with Adversarial Information Factorization

Generative models, such as variational auto-encoders (VAE) and generativ...
research
11/12/2020

VCE: Variational Convertor-Encoder for One-Shot Generalization

Variational Convertor-Encoder (VCE) converts an image to various styles;...
research
04/07/2019

Teaching GANs to Sketch in Vector Format

Sketching is more fundamental to human cognition than speech. Deep Neura...
research
12/05/2016

Authoring image decompositions with generative models

We show how to extend traditional intrinsic image decompositions to inco...
research
07/13/2019

Neural Embedding for Physical Manipulations

In common real-world robotic operations, action and state spaces can be ...

Please sign up or login with your details

Forgot password? Click here to reset