Semi-Supervised Image-to-Image Translation using Latent Space Mapping

03/29/2022
by   Pan Zhang, et al.
7

Recent image-to-image translation works have been transferred from supervised to unsupervised settings due to the expensive cost of capturing or labeling large amounts of paired data. However, current unsupervised methods using the cycle-consistency constraint may not find the desired mapping, especially for difficult translation tasks. On the other hand, a small number of paired data are usually accessible. We therefore introduce a general framework for semi-supervised image translation. Unlike previous works, our main idea is to learn the translation over the latent feature space instead of the image space. Thanks to the low dimensional feature space, it is easier to find the desired mapping function, resulting in improved quality of translation results as well as the stability of the translation model. Empirically we show that using feature translation generates better results, even using a few bits of paired data. Experimental comparisons with state-of-the-art approaches demonstrate the effectiveness of the proposed framework on a variety of challenging image-to-image translation tasks

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
06/23/2023

A Semi-Paired Approach For Label-to-Image Translation

Data efficiency, or the ability to generalize from a few labeled data, r...
research
04/15/2019

Implicit Pairs for Boosting Unpaired Image-to-Image Translation

In image-to-image translation the goal is to learn a mapping from one im...
research
09/12/2023

Hierarchical Conditional Semi-Paired Image-to-Image Translation For Multi-Task Image Defect Correction On Shopping Websites

On shopping websites, product images of low quality negatively affect cu...
research
01/24/2022

Paired Image to Image Translation for Strikethrough Removal From Handwritten Words

Transcribing struck-through, handwritten words, for example for the purp...
research
07/24/2020

The Surprising Effectiveness of Linear Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation is an inherently ill-posed probl...
research
01/24/2020

Kernel of CycleGAN as a Principle homogeneous space

Unpaired image-to-image translation has attracted significant interest d...
research
09/15/2020

Learning Functors using Gradient Descent

Neural networks are a general framework for differentiable optimization ...

Please sign up or login with your details

Forgot password? Click here to reset