Show, Attend and Translate: Unpaired Multi-Domain Image-to-Image Translation with Visual Attention

11/19/2018
by   Honglun Zhang, et al.
0

Recently unpaired multi-domain image-to-image translation has attracted great interests and obtained remarkable progress, where a label vector is utilized to indicate multi-domain information. In this paper, we propose SAT (Show, Attend and Translate), an unified and explainable generative adversarial network equipped with visual attention that can perform unpaired image-to-image translation for multiple domains. By introducing an action vector, we treat the original translation tasks as problems of arithmetic addition and subtraction. Visual attention is applied to guarantee that only the regions relevant to the target domains are translated. Extensive experiments on a facial attribute dataset demonstrate the superiority of our approach and the generated attention masks better explain what SAT attends when translating images.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 9

page 10

research
11/26/2017

In2I : Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks

In unsupervised image-to-image translation, the goal is to learn the map...
research
05/28/2018

Less is More: Unified Model for Unsupervised Multi-Domain Image-to-Image Translation

In this paper, we aim at solving the multi-domain image-to-image transla...
research
01/05/2020

Informative Sample Mining Network for Multi-Domain Image-to-Image Translation

The performance of multi-domain image-to-image translation has been sign...
research
09/09/2019

Learning a Self-inverse Network for Unpaired Bidirectional Image-to-image Translation

Recently image-to-image translation has attracted significant interests ...
research
09/02/2020

GAIT: Gradient Adjusted Unsupervised Image-to-Image Translation

Image-to-image translation (IIT) has made much progress recently with th...
research
06/06/2018

Unsupervised Attention-guided Image to Image Translation

Current unsupervised image-to-image translation techniques struggle to f...
research
12/03/2021

Panoptic-based Object Style-Align for Image-to-Image Translation

Despite remarkable recent progress in image translation, the complex sce...

Please sign up or login with your details

Forgot password? Click here to reset