DeepAI
Log In Sign Up

Learning image-to-image translation using paired and unpaired training samples

05/08/2018
by   Soumya Tripathy, et al.
2

Image-to-image translation is a general name for a task where an image from one domain is converted to a corresponding image in another domain, given sufficient training data. Traditionally different approaches have been proposed depending on whether aligned image pairs or two sets of (unaligned) examples from both domains are available for training. While paired training samples might be difficult to obtain, the unpaired setup leads to a highly under-constrained problem and inferior results. In this paper, we propose a new general purpose image-to-image translation model that is able to utilize both paired and unpaired training data simultaneously. We compare our method with two strong baselines and obtain both qualitatively and quantitatively improved results. Our model outperforms the baselines also in the case of purely paired and unpaired training data. To our knowledge, this is the first work to consider such hybrid setup in image-to-image translation.

READ FULL TEXT

page 2

page 8

page 10

page 15

page 16

page 17

page 18

page 19

09/24/2021

Unaligned Image-to-Image Translation by Learning to Reweight

Unsupervised image-to-image translation aims at learning the mapping fro...
04/15/2019

Implicit Pairs for Boosting Unpaired Image-to-Image Translation

In image-to-image translation the goal is to learn a mapping from one im...
11/11/2020

Zero-Pair Image to Image Translation using Domain Conditional Normalization

In this paper, we propose an approach based on domain conditional normal...
09/18/2019

Extremely Weak Supervised Image-to-Image Translation for Semantic Segmentation

Recent advances in generative models and adversarial training have led t...
01/24/2022

Paired Image to Image Translation for Strikethrough Removal From Handwritten Words

Transcribing struck-through, handwritten words, for example for the purp...
09/23/2022

Image-to-Image Translation for Autonomous Driving from Coarsely-Aligned Image Pairs

A self-driving car must be able to reliably handle adverse weather condi...

Code Repositories

Learningimage-to-imagetranslationusingpairedandunpairedtrainingsamples

"Learning image-to-image translation using paired and unpaired training samples" (https://arxiv.org/pdf/1805.03189.pdf))


view repo