Lightweight Generative Adversarial Networks for Text-Guided Image Manipulation

10/23/2020
by   Bowen Li, et al.
4

We propose a novel lightweight generative adversarial network for efficient image manipulation using natural language descriptions. To achieve this, a new word-level discriminator is proposed, which provides the generator with fine-grained training feedback at word-level, to facilitate training a lightweight generator that has a small number of parameters, but can still correctly focus on specific visual attributes of an image, and then edit them without affecting other contents that are not described in the text. Furthermore, thanks to the explicit training signal related to each word, the discriminator can also be simplified to have a lightweight structure. Compared with the state of the art, our method has a much smaller number of parameters, but still achieves a competitive manipulation performance. Extensive experimental results demonstrate that our method can better disentangle different visual attributes, then correctly map them to corresponding semantic words, and thus achieve a more accurate image modification using natural language descriptions.

READ FULL TEXT

page 2

page 7

page 9

research
09/16/2019

Controllable Text-to-Image Generation

In this paper, we propose a novel controllable text-to-image generative ...
research
12/16/2019

Image Manipulation with Natural Language using Two-sidedAttentive Conditional Generative Adversarial Network

Altering the content of an image with photo editing tools is a tedious t...
research
10/29/2018

Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Language

This paper addresses the problem of manipulating images using natural la...
research
12/12/2019

ManiGAN: Text-Guided Image Manipulation

The goal of our paper is to semantically edit parts of an image to match...
research
02/12/2020

Image-to-Image Translation with Text Guidance

The goal of this paper is to embed controllable factors, i.e., natural l...
research
05/31/2017

Adversarial Ranking for Language Generation

Generative adversarial networks (GANs) have great successes on synthesiz...
research
02/26/2018

Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Network

This paper presents a novel method to deal with the challenging task of ...

Please sign up or login with your details

Forgot password? Click here to reset