Transformation Autoregressive Networks

01/30/2018
by   Junier B. Oliva, et al.
0

The fundamental task of general density estimation has been of keen interest to machine learning. Recent advances in density estimation have either: a) proposed a flexible model to estimate the conditional factors of the chain rule, p(x_i | x_i-1, ...); or b) used flexible, non-linear transformations of variables of a simple base distribution. Instead, this work jointly leverages transformations of variables and autoregressive conditional models, and proposes novel methods for both. We provide a deeper understanding of our methods, showing a considerable improvement through a comprehensive study over both real world and synthetic data. Moreover, we illustrate the use of our models in outlier detection and image modeling tasks.

READ FULL TEXT
research
05/19/2017

Masked Autoregressive Flow for Density Estimation

Autoregressive models are among the best performing neural density estim...
research
04/11/2019

Autoregressive Energy Machines

Neural density estimators are flexible families of parametric models whi...
research
02/05/2019

Permutation Invariant Likelihoods and Equivariant Transformations

In this work, we fill a substantial void in machine learning and statist...
research
06/01/2018

Inverting Supervised Representations with Autoregressive Neural Density Models

Understanding the nature of representations learned by supervised machin...
research
03/10/2017

Parallel Multiscale Autoregressive Density Estimation

PixelCNN achieves state-of-the-art results in density estimation for nat...
research
06/07/2016

Better Conditional Density Estimation for Neural Networks

The vast majority of the neural network literature focuses on predicting...
research
03/03/2019

Conditional Density Estimation with Neural Networks: Best Practices and Benchmarks

Given a set of empirical observations, conditional density estimation ai...

Please sign up or login with your details

Forgot password? Click here to reset