Few-Shot Unsupervised Image-to-Image Translation

05/05/2019
by   Ming-Yu Liu, et al.
20

Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods require access to many images in both source and destination classes at training time. We argue this greatly limits their use. Drawing inspiration from the human capability of picking up the essence of a novel object from a small number of examples and generalizing from there, we seek a few-shot, unsupervised image-to-image translation algorithm that works on previously unseen target classes that are specified, at test time, only by a few example images. Our model achieves this few-shot generation capability by coupling an adversarial training scheme with a novel network design. Through extensive experimental validation and comparisons to several baseline methods on benchmark datasets, we verify the effectiveness of the proposed framework. Code will be available at https://nvlabs.github.io/FUNIT .

READ FULL TEXT

page 5

page 6

page 8

page 14

page 15

page 17

page 18

page 19

research
07/15/2020

COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder

Unsupervised image-to-image translation intends to learn a mapping of an...
research
07/28/2020

Toward Zero-Shot Unsupervised Image-to-Image Translation

Recent studies have shown remarkable success in unsupervised image-to-im...
research
03/23/2022

Learning to generate line drawings that convey geometry and semantics

This paper presents an unpaired method for creating line drawings from p...
research
06/20/2022

Test-time image-to-image translation ensembling improves out-of-distribution generalization in histopathology

Histopathology whole slide images (WSIs) can reveal significant inter-ho...
research
11/26/2021

ManiFest: Manifold Deformation for Few-shot Image Translation

Most image-to-image translation methods require a large number of traini...
research
06/07/2021

Few-Shot Unsupervised Image-to-Image Translation on complex scenes

Unsupervised image-to-image translation methods have received a lot of a...
research
09/02/2020

GAIT: Gradient Adjusted Unsupervised Image-to-Image Translation

Image-to-image translation (IIT) has made much progress recently with th...

Please sign up or login with your details

Forgot password? Click here to reset