Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation

06/16/2021
by   Yahui Liu, et al.
9

Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during interpolation, and usually perform poorly in interpolations across domains. In this paper, we propose a new training protocol based on three specific losses which help a translation network to learn a smooth and disentangled latent style space in which: 1) Both intra- and inter-domain interpolations correspond to gradual changes in the generated images and 2) The content of the source image is better preserved during the translation. Moreover, we propose a novel evaluation metric to properly measure the smoothness of latent style space of I2I translation models. The proposed method can be plugged into existing translation approaches, and our extensive experiments on different datasets show that it can significantly boost the quality of the generated images and the graduality of the interpolations.

READ FULL TEXT

page 16

page 17

page 18

page 19

page 20

page 21

page 22

page 23

research
08/11/2020

Retrieval Guided Unsupervised Multi-domain Image-to-Image Translation

Image to image translation aims to learn a mapping that transforms an im...
research
10/03/2022

Smooth image-to-image translations with latent space interpolations

Multi-domain image-to-image (I2I) translations can transform a source im...
research
12/10/2018

SMIT: Stochastic Multi-Label Image-to-Image Translation

Cross-domain mapping has been a very active topic in recent years. Given...
research
10/13/2021

Harnessing the Conditioning Sensorium for Improved Image Translation

Multi-modal domain translation typically refers to synthesizing a novel ...
research
08/27/2020

Metrics for Exposing the Biases of Content-Style Disentanglement

Recent state-of-the-art semi- and un-supervised solutions for challengin...
research
07/23/2021

AD-GAN: End-to-end Unsupervised Nuclei Segmentation with Aligned Disentangling Training

We consider unsupervised cell nuclei segmentation in this paper. Exploit...
research
05/27/2019

Plug-in Factorization for Latent Representation Disentanglement

In this work, we propose a Factorized Disentangler-Entangler Network (FD...

Please sign up or login with your details

Forgot password? Click here to reset