Multi-Resolution Continuous Normalizing Flows

06/15/2021
by   Vikram Voleti, et al.
0

Recent work has shown that Neural Ordinary Differential Equations (ODEs) can serve as generative models of images using the perspective of Continuous Normalizing Flows (CNFs). Such models offer exact likelihood calculation, and invertible generation/density estimation. In this work we introduce a Multi-Resolution variant of such models (MRCNF), by characterizing the conditional distribution over the additional information required to generate a fine image that is consistent with the coarse image. We introduce a transformation between resolutions that allows for no change in the log likelihood. We show that this approach yields comparable likelihood values for various image datasets, with improved performance at higher resolutions, with fewer parameters, using only 1 GPU. Further, we examine the out-of-distribution properties of (Multi-Resolution) Continuous Normalizing Flows, and find that they are similar to those of other likelihood-based generative models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 16

10/02/2018

FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models

A promising class of generative models maps points from a simple distrib...
10/07/2020

Equivariant Normalizing Flows for Point Processes and Sets

A point process describes how random sets of exchangeable points are gen...
02/05/2019

TzK: Flow-Based Conditional Generative Model

We formulate a new class of conditional generative models based on proba...
09/30/2019

Localised Generative Flows

We argue that flow-based density models based on continuous bijections a...
12/09/2019

InfoCNF: An Efficient Conditional Continuous Normalizing Flow with Adaptive Solvers

Continuous Normalizing Flows (CNFs) have emerged as promising deep gener...
08/11/2020

ClimAlign: Unsupervised statistical downscaling of climate variables via normalizing flows

Downscaling is a landmark task in climate science and meteorology in whi...
01/19/2017

PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications

PixelCNNs are a recently proposed class of powerful generative models wi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.