InfinityGAN: Towards Infinite-Resolution Image Synthesis

04/28/2021
by   hubert0527, et al.
0

We present InfinityGAN, a method to generate arbitrary-resolution images. The problem is associated with several key challenges. First, scaling existing models to a high resolution is resource-constrained, both in terms of computation and availability of high-resolution training data. Infinity-GAN trains and infers patch-by-patch seamlessly with low computational resources. Second, large images should be locally and globally consistent, avoid repetitive patterns, and look realistic. To address these, InfinityGAN takes global appearance, local structure and texture into account.With this formulation, we can generate images with resolution and level of detail not attainable before. Experimental evaluation supports that InfinityGAN generates imageswith superior global structure compared to baselines at the same time featuring parallelizable inference. Finally, we how several applications unlocked by our approach, such as fusing styles spatially, multi-modal outpainting and image inbetweening at arbitrary input and output resolutions

READ FULL TEXT

page 12

page 15

page 16

page 17

page 19

page 21

page 22

page 23

research
04/14/2022

Any-resolution Training for High-resolution Image Synthesis

Generative models operate at fixed resolution, even though natural image...
research
07/20/2022

NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis

In this paper, we present NUWA-Infinity, a generative model for infinite...
research
10/06/2020

Memory-efficient GAN-based Domain Translation of High Resolution 3D Medical Images

Generative adversarial networks (GANs) are currently rarely applied on 3...
research
09/05/2023

Generating Infinite-Resolution Texture using GANs with Patch-by-Patch Paradigm

In this paper, we introduce a novel approach for generating texture imag...
research
02/28/2022

OUR-GAN: One-shot Ultra-high-Resolution Generative Adversarial Networks

We propose OUR-GAN, the first one-shot ultra-high-resolution (UHR) image...
research
08/25/2020

AgingMapGAN (AMGAN): High-Resolution Controllable Face Aging with Spatially-Aware Conditional GANs

Existing approaches and datasets for face aging produce results skewed t...
research
07/27/2022

PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on

Image-based virtual try-on is one of the most promising applications of ...

Please sign up or login with your details

Forgot password? Click here to reset