Unpaired Image-to-Image Translation using Adversarial Consistency Loss

03/10/2020
by   Yihao Zhao, et al.
0

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However, due to the strict pixel-level constraint, it cannot perform geometric changes, remove large objects, or ignore irrelevant texture. In this paper, we propose a novel adversarial-consistency loss for image-to-image translation. This loss does not require the translated image to be translated back to be a specific source image but can encourage the translated images to retain important features of the source images and overcome the drawbacks of cycle-consistency loss noted above. Our method achieves state-of-the-art results on three challenging tasks: glasses removal, male-to-female translation, and selfie-to-anime translation.

READ FULL TEXT

page 1

page 4

page 9

page 10

page 11

page 12

page 14

research
11/26/2017

In2I : Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks

In unsupervised image-to-image translation, the goal is to learn the map...
research
09/06/2023

Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applications

In surgical computer vision applications, obtaining labeled training dat...
research
04/02/2021

The Spatially-Correlative Loss for Various Image Translation Tasks

We propose a novel spatially-correlative loss that is simple, efficient ...
research
11/24/2019

Breaking the cycle – Colleagues are all you need

This paper proposes a novel approach to performing image-to-image transl...
research
12/04/2017

GANerated Hands for Real-time 3D Hand Tracking from Monocular RGB

We address the highly challenging problem of real-time 3D hand tracking ...
research
08/05/2019

Adversarial Self-Defense for Cycle-Consistent GANs

The goal of unsupervised image-to-image translation is to map images fro...
research
03/21/2021

Self adversarial attack as an augmentation method for immunohistochemical stainings

It has been shown that unpaired image-to-image translation methods const...

Please sign up or login with your details

Forgot password? Click here to reset