Explicitly Minimizing the Blur Error of Variational Autoencoders

04/12/2023
by   Gustav Bredell, et al.
4

Variational autoencoders (VAEs) are powerful generative modelling methods, however they suffer from blurry generated samples and reconstructions compared to the images they have been trained on. Significant research effort has been spent to increase the generative capabilities by creating more flexible models but often flexibility comes at the cost of higher complexity and computational cost. Several works have focused on altering the reconstruction term of the evidence lower bound (ELBO), however, often at the expense of losing the mathematical link to maximizing the likelihood of the samples under the modeled distribution. Here we propose a new formulation of the reconstruction term for the VAE that specifically penalizes the generation of blurry images while at the same time still maximizing the ELBO under the modeled distribution. We show the potential of the proposed loss on three different data sets, where it outperforms several recently proposed reconstruction losses for VAEs.

READ FULL TEXT

page 7

page 8

page 9

page 13

page 14

page 15

page 16

research
09/27/2019

"Best-of-Many-Samples" Distribution Matching

Generative Adversarial Networks (GANs) can achieve state-of-the-art samp...
research
02/06/2016

Ladder Variational Autoencoders

Variational Autoencoders are powerful models for unsupervised learning. ...
research
03/01/2021

A survey on Variational Autoencoders from a GreenAI perspective

Variational AutoEncoders (VAEs) are powerful generative models that merg...
research
01/06/2021

Attention-based Convolutional Autoencoders for 3D-Variational Data Assimilation

We propose a new 'Bi-Reduced Space' approach to solving 3D Variational D...
research
03/01/2022

Variational Autoencoders Without the Variation

Variational autoencdoers (VAE) are a popular approach to generative mode...
research
02/28/2017

Towards Deeper Understanding of Variational Autoencoding Models

We propose a new family of optimization criteria for variational auto-en...
research
01/19/2022

Simpler is better: spectral regularization and up-sampling techniques for variational autoencoders

Full characterization of the spectral behavior of generative models base...

Please sign up or login with your details

Forgot password? Click here to reset