ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation

09/26/2021
by   Yahui Liu, et al.
2

Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains challenging. Existing works do not often preserve the domain-invariant part of the image (e.g., the identity in human face translations), they do not usually handle multiple domains, or do not allow for multi-modal translations. This work proposes an implicit style function (ISF) to straightforwardly achieve multi-modal and multi-domain image-to-image translation from pre-trained unconditional generators. The ISF manipulates the semantics of an input latent code to make the image generated from it lying in the desired visual domain. Our results in human face and animal manipulations show significantly improved results over the baselines. Our model enables cost-effective multi-modal unsupervised image-to-image translations at high resolution using pre-trained unconditional GANs. The code and data are available at: <https://github.com/yhlleo/stylegan-mmuit>.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

page 9

page 10

page 12

research
08/03/2020

Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation

We present a generic image-to-image translation framework, Pixel2Style2P...
research
10/13/2021

Harnessing the Conditioning Sensorium for Improved Image Translation

Multi-modal domain translation typically refers to synthesizing a novel ...
research
04/14/2021

StEP: Style-based Encoder Pre-training for Multi-modal Image Synthesis

We propose a novel approach for multi-modal Image-to-image (I2I) transla...
research
11/24/2019

Breaking the cycle – Colleagues are all you need

This paper proposes a novel approach to performing image-to-image transl...
research
03/19/2020

High-Resolution Daytime Translation Without Domain Labels

Modeling daytime changes in high resolution photographs, e.g., re-render...
research
01/11/2019

Image Disentanglement and Uncooperative Re-Entanglement for High-Fidelity Image-to-Image Translation

Cross-domain image-to-image translation should satisfy two requirements:...
research
10/13/2022

What's in a Decade? Transforming Faces Through Time

How can one visually characterize people in a decade? In this work, we a...

Please sign up or login with your details

Forgot password? Click here to reset