Lipschitz Regularized CycleGAN for Improving Semantic Robustness in Unpaired Image-to-image Translation

12/09/2020
by   Zhiwei Jia, et al.
0

For unpaired image-to-image translation tasks, GAN-based approaches are susceptible to semantic flipping, i.e., contents are not preserved consistently. We argue that this is due to (1) the difference in semantic statistics between source and target domains and (2) the learned generators being non-robust. In this paper, we proposed a novel approach, Lipschitz regularized CycleGAN, for improving semantic robustness and thus alleviating the semantic flipping issue. During training, we add a gradient penalty loss to the generators, which encourages semantically consistent transformations. We evaluate our approach on multiple common datasets and compare with several existing GAN-based methods. Both quantitative and visual results suggest the effectiveness and advantage of our approach in producing robust transformations with fewer semantic flipping.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

research
03/26/2021

Multiple GAN Inversion for Exemplar-based Image-to-Image Translation

Existing state-of-the-art techniques in exemplar-based image-to-image tr...
research
03/07/2023

Guided Image-to-Image Translation by Discriminator-Generator Communication

The goal of Image-to-image (I2I) translation is to transfer an image fro...
research
02/25/2019

TraVeLGAN: Image-to-image Translation by Transformation Vector Learning

Interest in image-to-image translation has grown substantially in recent...
research
12/03/2021

Semantic Map Injected GAN Training for Image-to-Image Translation

Image-to-image translation is the recent trend to transform images from ...
research
12/30/2021

Leveraging in-domain supervision for unsupervised image-to-image translation tasks via multi-stream generators

Supervision for image-to-image translation (I2I) tasks is hard to come b...
research
11/09/2022

ParGAN: Learning Real Parametrizable Transformations

Current methods for image-to-image translation produce compelling result...
research
02/26/2019

Harmonic Unpaired Image-to-image Translation

The recent direction of unpaired image-to-image translation is on one ha...

Please sign up or login with your details

Forgot password? Click here to reset