Toward Zero-Shot Unsupervised Image-to-Image Translation

07/28/2020
by   Yuanqi Chen, et al.
0

Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from mode collapse, which limits the application of the existing methods. In this work, we propose a zero-shot unsupervised image-to-image translation framework to address this limitation, by associating categories with their side information like attributes. To generalize the translator to previous unseen classes, we introduce two strategies for exploiting the space spanned by the semantic attributes. Specifically, we propose to preserve semantic relations to the visual space and expand attribute space by utilizing attribute vectors of unseen classes, thus encourage the translator to explore the modes of unseen classes. Quantitative and qualitative results on different datasets demonstrate the effectiveness of our proposed approach. Moreover, we demonstrate that our framework can be applied to many tasks, such as zero-shot classification and fashion design.

READ FULL TEXT

page 3

page 12

page 13

page 15

page 16

page 18

page 26

page 27

research
06/01/2019

ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation

Image-to-image translation models have shown remarkable ability on trans...
research
05/05/2019

Few-Shot Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation methods learn to map images in a...
research
03/15/2020

GMM-UNIT: Unsupervised Multi-Domain and Multi-Modal Image-to-Image Translation via Attribute Gaussian Mixture Modeling

Unsupervised image-to-image translation (UNIT) aims at learning a mappin...
research
10/08/2019

Semi Few-Shot Attribute Translation

Recent studies have shown remarkable success in image-to-image translati...
research
08/20/2019

RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes

Multi-domain image-to-image translation has gained increasing attention ...
research
04/24/2023

UTSGAN: Unseen Transition Suss GAN for Transition-Aware Image-to-image Translation

In the field of Image-to-Image (I2I) translation, ensuring consistency b...
research
03/02/2020

Addressing target shift in zero-shot learning using grouped adversarial learning

In this paper, we present a new paradigm to zero-shot learning (ZSL) tha...

Please sign up or login with your details

Forgot password? Click here to reset