Semi-supervised Learning for Few-shot Image-to-Image Translation

03/30/2020
by   Yaxing Wang, et al.
5

In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Recently, some methods have tackled the challenging setting of few-shot image-to-image translation, reducing the labeled data requirements for the target domain during inference. In this work, we go one step further and reduce the amount of required labeled data also from the source domain during training. To do so, we propose applying semi-supervised learning via a noise-tolerant pseudo-labeling procedure. We also apply a cycle consistency constraint to further exploit the information from unlabeled images, either from the same dataset or external. Additionally, we propose several structural modifications to facilitate the image translation task under these circumstances. Our semi-supervised method for few-shot image translation, called SEMIT, achieves excellent results on four different datasets using as little as 10% of the source labels, and matches the performance of the main fully-supervised competitor using only 20% labeled data. Our code and models are made public at: <https://github.com/yaxingwang/SEMIT>.

READ FULL TEXT

page 11

page 12

page 13

page 15

page 16

page 17

page 18

page 19

research
11/05/2021

Semantic Consistency in Image-to-Image Translation for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation (UDA) aims to adapt models trained on a s...
research
07/15/2020

Transformation Consistency Regularization- A Semi-Supervised Paradigm for Image-to-Image Translation

Scarcity of labeled data has motivated the development of semi-supervise...
research
12/22/2021

Meta-Learning and Self-Supervised Pretraining for Real World Image Translation

Recent advances in deep learning, in particular enabled by hardware adva...
research
07/22/2023

Self-Supervised and Semi-Supervised Polyp Segmentation using Synthetic Data

Early detection of colorectal polyps is of utmost importance for their t...
research
11/07/2018

DragonPaint: Rule based bootstrapping for small data with an application to cartoon coloring

In this paper, we confront the problem of deep learning's big labeled da...
research
03/11/2023

Semi-supervised Hand Appearance Recovery via Structure Disentanglement and Dual Adversarial Discrimination

Enormous hand images with reliable annotations are collected through mar...
research
04/29/2019

Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning

Unpaired Image-to-Image Translation (UIT) focuses on translating images ...

Please sign up or login with your details

Forgot password? Click here to reset