Contrastive Learning for Unsupervised Image-to-Image Translation

05/07/2021
by   Hanbit Lee, et al.
0

Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain labels in training a model to distinguish between distinct visual features. Such dependency on labels often significantly limits the scope of applications since consistent and high-quality labels are expensive. Instead, we wish to capture visual features from images themselves and apply them to enable realistic translation without human-generated labels. To this end, we propose an unsupervised image-to-image translation method based on contrastive learning. The key idea is to learn a discriminator that differentiates between distinctive styles and let the discriminator supervise a generator to transfer those styles across images. During training, we randomly sample a pair of images and train the generator to change the appearance of one towards another while keeping the original structure. Experimental results show that our method outperforms the leading unsupervised baselines in terms of visual quality and translation accuracy.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 13

page 14

page 15

page 16

research
04/15/2021

Dual Contrastive Learning for Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation tasks aim to find a mapping betw...
research
03/30/2021

SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translation

For unsupervised image-to-image translation, we propose a discriminator ...
research
04/05/2020

Structural-analogy from a Single Image Pair

The task of unsupervised image-to-image translation has seen substantial...
research
08/10/2021

Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation

Contrastive learning shows great potential in unpaired image-to-image tr...
research
12/19/2017

ComboGAN: Unrestrained Scalability for Image Domain Translation

This year alone has seen unprecedented leaps in the area of learning-bas...
research
09/25/2021

Contrastive Unpaired Translation using Focal Loss for Patch Classification

Image-to-image translation models transfer images from input domain to o...
research
08/13/2018

Improving Shape Deformation in Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation techniques are able to map local...

Please sign up or login with your details

Forgot password? Click here to reset