DeepAI AI Chat
Log In Sign Up

Deep Feature Consistent Variational Autoencoder

by   Xianxu Hou, et al.
The University of Nottingham Ningbo China
Shenzhen University

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the spatial correlation characteristics of the input, thus leading the output to have a more natural visual appearance and better perceptual quality. Based on recent deep learning works such as style transfer, we employ a pre-trained deep convolutional neural network (CNN) and use its hidden features to define a feature perceptual loss for VAE training. Evaluated on the CelebA face dataset, we show that our model produces better results than other methods in the literature. We also show that our method can produce latent vectors that can capture the semantic information of face expressions and can be used to achieve state-of-the-art performance in facial attribute prediction.


page 4

page 5

page 7


Improving Variational Autoencoder with Deep Feature Consistent and Generative Adversarial Training

We present a new method for improving the performances of variational au...

TVAE: Triplet-Based Variational Autoencoder using Metric Learning

Deep metric learning has been demonstrated to be highly effective in lea...

Anomaly localization by modeling perceptual features

Although unsupervised generative modeling of an image dataset using a Va...

Face Reconstruction with Variational Autoencoder and Face Masks

Variational AutoEncoders (VAE) employ deep learning models to learn a co...

CosmoVAE: Variational Autoencoder for CMB Image Inpainting

Cosmic microwave background radiation (CMB) is critical to the understan...

Deep Variational Autoencoder with Shallow Parallel Path for Top-N Recommendation (VASP)

Recently introduced EASE algorithm presents a simple and elegant way, ho...

Variational Autoencoding the Lagrangian Trajectories of Particles in a Combustion System

We introduce a deep learning method to simulate the motion of particles ...