Aligning Latent and Image Spaces to Connect the Unconnectable

04/14/2021
by   Ivan Skorokhodov, et al.
9

In this work, we develop a method to generate infinite high-resolution images with diverse and complex content. It is based on a perfectly equivariant generator with synchronous interpolations in the image and latent spaces. Latent codes, when sampled, are positioned on the coordinate grid, and each pixel is computed from an interpolation of the nearby style codes. We modify the AdaIN mechanism to work in such a setup and train the generator in an adversarial setting to produce images positioned between any two latent vectors. At test time, this allows for generating complex and diverse infinite images and connecting any two unrelated scenes into a single arbitrarily large panorama. Apart from that, we introduce LHQ: a new dataset of high-resolution nature landscapes. We test the approach on LHQ, LSUN Tower and LSUN Bridge and outperform the baselines by at least 4 times in terms of quality and diversity of the produced infinite images. The project page is located at https://universome.github.io/alis.

READ FULL TEXT

page 7

page 8

page 19

page 20

page 21

page 22

page 23

page 24

research
09/09/2019

An Acceleration Framework for High Resolution Image Synthesis

Synthesis of high resolution images using Generative Adversarial Network...
research
03/04/2020

Creating High Resolution Images with a Latent Adversarial Generator

Generating realistic images is difficult, and many formulations for this...
research
06/13/2021

Styleformer: Transformer based Generative Adversarial Networks with Style Vector

We propose Styleformer, which is a style-based generator for GAN archite...
research
02/07/2023

High-Resolution GAN Inversion for Degraded Images in Large Diverse Datasets

The last decades are marked by massive and diverse image data, which sho...
research
08/07/2022

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

Progress in GANs has enabled the generation of high-resolution photoreal...
research
07/03/2023

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion

This paper introduces MVDiffusion, a simple yet effective multi-view ima...
research
05/22/2017

Semantically Decomposing the Latent Spaces of Generative Adversarial Networks

We propose a new algorithm for training generative adversarial networks ...

Please sign up or login with your details

Forgot password? Click here to reset