Toward Spatially Unbiased Generative Models

08/03/2021
by   Jooyoung Choi, et al.
14

Recent image generation models show remarkable generation performance. However, they mirror strong location preference in datasets, which we call spatial bias. Therefore, generators render poor samples at unseen locations and scales. We argue that the generators rely on their implicit positional encoding to render spatial content. From our observations, the generator's implicit positional encoding is translation-variant, making the generator spatially biased. To address this issue, we propose injecting explicit positional encoding at each scale of the generator. By learning the spatially unbiased generator, we facilitate the robust use of generators in multiple tasks, such as GAN inversion, multi-scale generation, generation of arbitrary sizes and aspect ratios. Furthermore, we show that our method can also be applied to denoising diffusion probabilistic models.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 8

page 9

page 10

page 11

research
12/09/2020

Positional Encoding as Spatial Inductive Bias in GANs

SinGAN shows impressive capability in learning internal patch distributi...
research
07/13/2020

Synthetic Dataset Generation with Itemset-Based Generative Models

This paper proposes three different data generators, tailored to transac...
research
10/06/2021

DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Models

Diffusion models are recent generative models that have shown great succ...
research
05/31/2022

A Kernelised Stein Statistic for Assessing Implicit Generative Models

Synthetic data generation has become a key ingredient for training machi...
research
03/25/2023

Spatial Latent Representations in Generative Adversarial Networks for Image Generation

In the majority of GAN architectures, the latent space is defined as a s...
research
07/28/2017

Generator Reversal

We consider the problem of training generative models with deep neural n...
research
08/23/2021

Revealing Distributional Vulnerability of Explicit Discriminators by Implicit Generators

An explicit discriminator trained on observable in-distribution (ID) sam...

Please sign up or login with your details

Forgot password? Click here to reset