DeepAI AI Chat
Log In Sign Up

Deep Feature Consistent Variational Autoencoder

10/02/2016
by   Xianxu Hou, et al.
The University of Nottingham Ningbo China
Shenzhen University
0

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the spatial correlation characteristics of the input, thus leading the output to have a more natural visual appearance and better perceptual quality. Based on recent deep learning works such as style transfer, we employ a pre-trained deep convolutional neural network (CNN) and use its hidden features to define a feature perceptual loss for VAE training. Evaluated on the CelebA face dataset, we show that our model produces better results than other methods in the literature. We also show that our method can produce latent vectors that can capture the semantic information of face expressions and can be used to achieve state-of-the-art performance in facial attribute prediction.

READ FULL TEXT

page 4

page 5

page 7

06/04/2019

Improving Variational Autoencoder with Deep Feature Consistent and Generative Adversarial Training

We present a new method for improving the performances of variational au...
02/13/2018

TVAE: Triplet-Based Variational Autoencoder using Metric Learning

Deep metric learning has been demonstrated to be highly effective in lea...
08/12/2020

Anomaly localization by modeling perceptual features

Although unsupervised generative modeling of an image dataset using a Va...
12/03/2021

Face Reconstruction with Variational Autoencoder and Face Masks

Variational AutoEncoders (VAE) employ deep learning models to learn a co...
01/31/2020

CosmoVAE: Variational Autoencoder for CMB Image Inpainting

Cosmic microwave background radiation (CMB) is critical to the understan...
02/10/2021

Deep Variational Autoencoder with Shallow Parallel Path for Top-N Recommendation (VASP)

Recently introduced EASE algorithm presents a simple and elegant way, ho...
11/29/2018

Variational Autoencoding the Lagrangian Trajectories of Particles in a Combustion System

We introduce a deep learning method to simulate the motion of particles ...