Roundtrip: A Deep Generative Neural Density Estimator

04/20/2020
by   Qiao Liu, et al.
32

Density estimation is a fundamental problem in both statistics and machine learning. We proposed Roundtrip as a universal neural density estimator based on deep generative models. Roundtrip exploits the advantage of GANs for generating samples and estimates density by either importance sampling or Laplace approximation. Unlike prior studies modeling target density by constructing a tractable Jacobian w.r.t to a base density (e.g., Gaussian), Roundtrip learns target density by generating a manifold from a base density to approximate the distribution of observation data. In a series of experiments, Roundtrip achieves state-of-the-art performance in a diverse range of density estimation tasks.

READ FULL TEXT
research
01/06/2019

Understanding the (un)interpretability of natural image distributions using generative models

Probability density estimation is a classical and well studied problem, ...
research
05/14/2018

Normal Similarity Network for Generative Modelling

Gaussian distributions are commonly used as a key building block in many...
research
03/16/2016

One-Shot Generalization in Deep Generative Models

Humans have an impressive ability to reason about new concepts and exper...
research
06/22/2022

Neural Inverse Transform Sampler

Any explicit functional representation f of a density is hampered by two...
research
02/24/2021

Density Sketches for Sampling and Estimation

We introduce Density sketches (DS): a succinct online summary of the dat...
research
10/07/2013

A Deep and Tractable Density Estimator

The Neural Autoregressive Distribution Estimator (NADE) and its real-val...
research
06/08/2021

Marginalizable Density Models

Probability density models based on deep networks have achieved remarkab...

Please sign up or login with your details

Forgot password? Click here to reset