Generative Flow via Invertible nxn Convolution

05/24/2019
by   Thanh-Dat Truong, et al.
0

Flow-based generative models have recently become one of the most efficient approaches to model the data generation. Indeed, they are constructed with a sequence of invertible and tractable transformations. Glow first introduced a simple type of generative flow using an invertible 1x1 convolution. However, the 1x1 convolution suffers from limited flexibility compared to the standard convolutions. In this paper, we propose a novel invertible nxn convolution approach that overcomes the limitations of the invertible 1x1 convolution. In addition, our proposed network is not only tractable and invertible but also uses fewer parameters than standard convolutions. The experiments on CIFAR-10, ImageNet, and Celeb-HQ datasets, have showed that our invertible nxn convolution helps to improve the performance of generative models significantly.

READ FULL TEXT

page 1

page 7

page 8

research
01/23/2023

FInC Flow: Fast and Invertible k × k Convolutions for Normalizing Flows

Invertible convolutions have been an essential element for building expr...
research
07/18/2019

MintNet: Building Invertible Neural Networks with Masked Convolutions

We propose a new way of constructing invertible neural networks by combi...
research
07/25/2019

HUGE2: a Highly Untangled Generative-model Engine for Edge-computing

As a type of prominent studies in deep learning, generative models have ...
research
01/25/2018

Generative Adversarial Networks using Adaptive Convolution

Most existing GANs architectures that generate images use transposed con...
research
02/08/2020

Time-aware Large Kernel Convolutions

To date, most state-of-the-art sequence modelling architectures use atte...
research
12/03/2020

MelGlow: Efficient Waveform Generative Network Based on Location-Variable Convolution

Recent neural vocoders usually use a WaveNet-like network to capture the...
research
01/30/2019

Emerging Convolutions for Generative Normalizing Flows

Generative flows are attractive because they admit exact likelihood opti...

Please sign up or login with your details

Forgot password? Click here to reset