Generative Flows with Matrix Exponential

07/19/2020
by   Changyi Xiao, et al.
0

Generative flows models enjoy the properties of tractable exact likelihood and efficient sampling, which are composed of a sequence of invertible functions. In this paper, we incorporate matrix exponential into generative flows. Matrix exponential is a map from matrices to invertible matrices, this property is suitable for generative flows. Based on matrix exponential, we propose matrix exponential coupling layers that are a general case of affine coupling layers and matrix exponential invertible 1 x 1 convolutions that do not collapse during training. And we modify the networks architecture to make trainingstable andsignificantly speed up the training process. Our experiments show that our model achieves great performance on density estimation amongst generative flows models.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 9

research
06/02/2020

The Convolution Exponential and Generalized Sylvester Flows

This paper introduces a new method to build linear flows, by taking the ...
research
06/08/2021

Densely connected normalizing flows

Normalizing flows are bijective mappings between inputs and latent repre...
research
07/03/2021

CInC Flow: Characterizable Invertible 3x3 Convolution

Normalizing flows are an essential alternative to GANs for generative mo...
research
02/07/2022

Universality of parametric Coupling Flows over parametric diffeomorphisms

Invertible neural networks based on Coupling Flows CFlows) have various ...
research
03/03/2022

Generative Modeling for Low Dimensional Speech Attributes with Neural Spline Flows

Despite recent advances in generative modeling for text-to-speech synthe...
research
10/02/2020

Representational aspects of depth and conditioning in normalizing flows

Normalizing flows are among the most popular paradigms in generative mod...
research
07/07/2021

Universal Approximation for Log-concave Distributions using Well-conditioned Normalizing Flows

Normalizing flows are a widely used class of latent-variable generative ...

Please sign up or login with your details

Forgot password? Click here to reset