Sinusoidal Flow: A Fast Invertible Autoregressive Flow

10/26/2021
by   Yumou Wei, et al.
0

Normalising flows offer a flexible way of modelling continuous probability distributions. We consider expressiveness, fast inversion and exact Jacobian determinant as three desirable properties a normalising flow should possess. However, few flow models have been able to strike a good balance among all these properties. Realising that the integral of a convex sum of sinusoidal functions squared leads to a bijective residual transformation, we propose Sinusoidal Flow, a new type of normalising flows that inherits the expressive power and triangular Jacobian from fully autoregressive flows while guaranteed by Banach fixed-point theorem to remain fast invertible and thereby obviate the need for sequential inversion typically required in fully autoregressive flows. Experiments show that our Sinusoidal Flow is not only able to model complex distributions, but can also be reliably inverted to generate realistic-looking samples even with many layers of transformations stacked.

READ FULL TEXT
research
03/04/2020

Gaussianization Flows

Iterative Gaussianization is a fixed-point iteration procedure that can ...
research
02/06/2020

Closing the Dequantization Gap: PixelCNN as a Single-Layer Flow

Flow models have recently made great progress at modeling quantized sens...
research
06/01/2020

You say Normalizing Flows I see Bayesian Networks

Normalizing flows have emerged as an important family of deep neural net...
research
06/02/2020

The Convolution Exponential and Generalized Sylvester Flows

This paper introduces a new method to build linear flows, by taking the ...
research
09/16/2020

Quasi-Autoregressive Residual (QuAR) Flows

Normalizing Flows are a powerful technique for learning and modeling pro...
research
06/17/2020

Towards Recurrent Autoregressive Flow Models

Stochastic processes generated by non-stationary distributions are diffi...
research
06/07/2017

Improving Variational Auto-Encoders using convex combination linear Inverse Autoregressive Flow

In this paper, we propose a new volume-preserving flow and show that it ...

Please sign up or login with your details

Forgot password? Click here to reset