DeepAI AI Chat
Log In Sign Up

Each Attribute Matters: Contrastive Attention for Sentence-based Image Editing

by   Liuqing Zhao, et al.

Sentence-based Image Editing (SIE) aims to deploy natural language to edit an image. Offering potentials to reduce expensive manual editing, SIE has attracted much interest recently. However, existing methods can hardly produce accurate editing and even lead to failures in attribute editing when the query sentence is with multiple editable attributes. To cope with this problem, by focusing on enhancing the difference between attributes, this paper proposes a novel model called Contrastive Attention Generative Adversarial Network (CA-GAN), which is inspired from contrastive training. Specifically, we first design a novel contrastive attention module to enlarge the editing difference between random combinations of attributes which are formed during training. We then construct an attribute discriminator to ensure effective editing on each attribute. A series of experiments show that our method can generate very encouraging results in sentence-based image editing with multiple attributes on CUB and COCO dataset. Our code is available at


page 2

page 4

page 8

page 10

page 18

page 19

page 20


PA-GAN: Progressive Attention Generative Adversarial Network for Facial Attribute Editing

Facial attribute editing aims to manipulate attributes on the human face...

Label2Label: A Language Modeling Framework for Multi-Attribute Learning

Objects are usually associated with multiple attributes, and these attri...

Garment Design with Generative Adversarial Networks

The designers' tendency to adhere to a specific mental set and heavy emo...

Learning by Planning: Language-Guided Global Image Editing

Recently, language-guided global image editing draws increasing attentio...

ManiCLIP: Multi-Attribute Face Manipulation from Text

In this paper we present a novel multi-attribute face manipulation metho...

HairCLIP: Design Your Hair by Text and Reference Image

Hair editing is an interesting and challenging problem in computer visio...

TaCo: Textual Attribute Recognition via Contrastive Learning

As textual attributes like font are core design elements of document for...