DeepAI AI Chat
Log In Sign Up

Improving Variational Autoencoder with Deep Feature Consistent and Generative Adversarial Training

by   Xianxu Hou, et al.
The University of Nottingham
Shenzhen University

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep features, we also implement a generative adversarial training mechanism to force the VAE to output realistic and natural images. We present experimental results to show that the VAE trained with our new method outperforms state of the art in generating face images with much clearer and more natural noses, eyes, teeth, hair textures as well as reasonable backgrounds. We also show that our method can learn powerful embeddings of input face images, which can be used to achieve facial attribute manipulation. Moreover we propose a multi-view feature extraction strategy to extract effective image representations, which can be used to achieve state of the art performance in facial attribute prediction.


page 12

page 13

page 14

page 16

page 17

page 18

page 19

page 20


Deep Feature Consistent Variational Autoencoder

We present a novel method for constructing Variational Autoencoder (VAE)...

Mask-aware Photorealistic Face Attribute Manipulation

The task of face attribute manipulation has found increasing application...

Attribute Enhanced Face Aging with Wavelet-based Generative Adversarial Networks

Since it is difficult to collect face images of the same subject over a ...

Channel-Recurrent Variational Autoencoders

Variational Autoencoder (VAE) is an efficient framework in modeling natu...

Autoencoding beyond pixels using a learned similarity metric

We present an autoencoder that leverages learned representations to bett...

Progressive VAE Training on Highly Sparse and Imbalanced Data

In this paper, we present a novel approach for training a Variational Au...

Detecting Bias with Generative Counterfactual Face Attribute Augmentation

We introduce a simple framework for identifying biases of a smiling attr...