Density estimation using Real NVP

05/27/2016
by   Laurent Dinh, et al.
0

Unsupervised learning of probabilistic models is a central yet challenging problem in machine learning. Specifically, designing models with tractable learning, sampling, inference and evaluation is crucial in solving this task. We extend the space of such models using real-valued non-volume preserving (real NVP) transformations, a set of powerful invertible and learnable transformations, resulting in an unsupervised learning algorithm with exact log-likelihood computation, exact sampling, exact inference of latent variables, and an interpretable latent space. We demonstrate its ability to model natural images on four datasets through sampling, log-likelihood evaluation and latent variable manipulations.

READ FULL TEXT

page 13

page 14

page 19

page 22

page 23

page 24

page 31

page 32

research
02/17/2020

On the Discrepancy between Density Estimation and Sequence Generation

Many sequence-to-sequence generation tasks, including machine translatio...
research
06/23/2022

LED: Latent Variable-based Estimation of Density

Modern generative models are roughly divided into two main categories: (...
research
02/06/2016

Ladder Variational Autoencoders

Variational Autoencoders are powerful models for unsupervised learning. ...
research
06/28/2019

Benefits of Overparameterization in Single-Layer Latent Variable Generative Models

One of the most surprising and exciting discoveries in supervising learn...
research
05/30/2017

Recurrent Estimation of Distributions

This paper presents the recurrent estimation of distributions (RED) for ...
research
02/28/2021

Neural Network Approach to Construction of Classical Integrable Systems

Integrable systems have provided various insights into physical phenomen...
research
01/25/2016

Pixel Recurrent Neural Networks

Modeling the distribution of natural images is a landmark problem in uns...

Please sign up or login with your details

Forgot password? Click here to reset