Least Square Variational Bayesian Autoencoder with Regularization

07/11/2017
by   Gautam Ramachandra, et al.
0

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder. Variational auto enocders make better approximaiton than MCMC. The VAE defines a generative process in terms of ancestral sampling through a cascade of hidden stochastic layers. They are a directed graphic models. Variational autoencoder is trained to maximise the variational lower bound. Here we are trying maximise the likelihood and also at the same time we are trying to make a good approximation of the data. Its basically trading of the data log-likelihood and the KL divergence from the true posterior. This paper describes the scenario in which we wish to find a point-estimate to the parameters θ of some parametric model in which we generate each observations by first sampling a local latent variable and then sampling the associated observation. Here we use least square loss function with regularization in the the reconstruction of the image, the least square loss function was found to give better reconstructed images and had a faster training time.

READ FULL TEXT
research
07/21/2019

Tutorial: Deriving the Standard Variational Autoencoder (VAE) Loss Function

In Bayesian machine learning, the posterior distribution is typically co...
research
12/11/2020

A Log-likelihood Regularized KL Divergence for Video Prediction with A 3D Convolutional Variational Recurrent Network

The use of latent variable models has shown to be a powerful tool for mo...
research
01/31/2020

CosmoVAE: Variational Autoencoder for CMB Image Inpainting

Cosmic microwave background radiation (CMB) is critical to the understan...
research
10/07/2019

Negative Sampling in Variational Autoencoders

We propose negative sampling as an approach to improve the notoriously b...
research
02/09/2019

Biadversarial Variational Autoencoder

In the original version of the Variational Autoencoder, Kingma et al. as...
research
11/21/2020

Use of Student's t-Distribution for the Latent Layer in a Coupled Variational Autoencoder

A Coupled Variational Autoencoder, which incorporates both a generalized...
research
02/06/2022

Enhancing variational generation through self-decomposition

In this article we introduce the notion of Split Variational Autoencoder...

Please sign up or login with your details

Forgot password? Click here to reset