AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks

11/27/2019
by   Hao Tang, et al.
52

State-of-the-art methods in the unpaired image-to-image translation are capable of learning a mapping from a source domain to a target domain with unpaired image data. Though the existing methods have achieved promising results, they still produce unsatisfied artifacts, being able to convert low-level information while limited in transforming high-level semantics of input images. One possible reason is that generators do not have the ability to perceive the most discriminative semantic parts between the source and target domains, thus making the generated images low quality. In this paper, we propose a new Attention-Guided Generative Adversarial Networks (AttentionGAN) for the unpaired image-to-image translation task. AttentionGAN can identify the most discriminative semantic objects and minimize changes of unwanted parts for semantic manipulation problems without using extra data and models. The attention-guided generators in AttentionGAN are able to produce attention masks via a built-in attention mechanism, and then fuse the generation output with the attention masks to obtain high-quality target images. Accordingly, we also design a novel attention-guided discriminator which only considers attended regions. Extensive experiments are conducted on several generative tasks, demonstrating that the proposed model is effective to generate sharper and more realistic images compared with existing competitive models. The source code for the proposed AttentionGAN is available at https://github.com/Ha0Tang/AttentionGAN.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 9

page 10

page 11

page 12

research
03/28/2019

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

The state-of-the-art approaches in Generative Adversarial Networks (GANs...
research
08/19/2019

SPA-GAN: Spatial Attention GAN for Image-to-Image Translation

Image-to-image translation is to learn a mapping between images from a s...
research
01/06/2019

Segmentation Guided Image-to-Image Translation with Adversarial Networks

Recently image-to-image translation has received increasing attention, w...
research
10/13/2022

What's in a Decade? Transforming Faces Through Time

How can one visually characterize people in a decade? In this work, we a...
research
08/01/2019

Content and Colour Distillation for Learning Image Translations with the Spatial Profile Loss

Generative adversarial networks has emerged as a defacto standard for im...
research
02/06/2023

Optimal Transport Guided Unsupervised Learning for Enhancing low-quality Retinal Images

Real-world non-mydriatic retinal fundus photography is prone to artifact...
research
03/07/2023

Generative Modeling with Flow-Guided Density Ratio Learning

We present Flow-Guided Density Ratio Learning (FDRL), a simple and scala...

Please sign up or login with your details

Forgot password? Click here to reset