Multi-mapping Image-to-Image Translation via Learning Disentanglement

09/17/2019
by   Xiaoming Yu, et al.
23

Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation. However, the existing methods only consider one of the two perspectives, which makes them unable to solve each other's problem. To address this issue, we propose a novel unified model, which bridges these two objectives. First, we disentangle the input images into the latent representations by an encoder-decoder architecture with a conditional adversarial training in the feature space. Then, we encourage the generator to learn multi-mappings by a random cross-domain translation. As a result, we can manipulate different parts of the latent representations to perform multi-modal and multi-domain translations simultaneously. Experiments demonstrate that our method outperforms state-of-the-art methods.

READ FULL TEXT

page 2

page 6

page 8

page 13

page 14

page 15

page 16

page 17

research
11/26/2017

In2I : Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks

In unsupervised image-to-image translation, the goal is to learn the map...
research
06/26/2018

Multi-Mapping Image-to-Image Translation with Central Biasing Normalization

Recent image-to-image translation tasks attempt to extend the model from...
research
05/14/2022

Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable

We propose Mask CycleGAN, a novel architecture for unpaired image domain...
research
07/26/2021

A Unified Hyper-GAN Model for Unpaired Multi-contrast MR Image Translation

Cross-contrast image translation is an important task for completing mis...
research
04/09/2019

Adversarial Learning of Disentangled and Generalizable Representations for Visual Attributes

Recently, a multitude of methods for image-to-image translation has demo...
research
03/08/2019

Mix and match networks: multi-domain alignment for unpaired image-to-image translation

This paper addresses the problem of inferring unseen cross-domain and cr...
research
11/20/2022

Constraining Multi-scale Pairwise Features between Encoder and Decoder Using Contrastive Learning for Unpaired Image-to-Image Translation

Contrastive learning (CL) has shown great potential in image-to-image tr...

Please sign up or login with your details

Forgot password? Click here to reset