Learning to Generate Compositional Color Descriptions

06/13/2016
by   Will Monroe, et al.
0

The production of color language is essential for grounded language generation. Color descriptions have many challenging properties: they can be vague, compositionally complex, and denotationally rich. We present an effective approach to generating color descriptions using recurrent neural networks and a Fourier-transformed color representation. Our model outperforms previous work on a conditional language modeling task over a large corpus of naturalistic color descriptions. In addition, probing the model's output reveals that it can accurately produce not only basic color terms but also descriptors with non-convex denotations ("greenish"), bare modifiers ("bright", "dull"), and compositional phrases ("faded teal") not seen in training.

READ FULL TEXT
09/27/2017

Learning Distributions of Meant Color

When a speaker says the name of a color, the color they picture is not n...
03/29/2017

Colors in Context: A Pragmatic Neural Model for Grounded Language Understanding

We present a model of pragmatic referring expression interpretation in a...
03/22/2018

Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings

We present a method for generating colored 3D shapes from natural langua...
10/03/2019

Modeling Color Terminology Across Thousands of Languages

There is an extensive history of scholarship into what constitutes a "ba...
09/24/2020

Grounded Compositional Outputs for Adaptive Language Modeling

Language models have emerged as a central component across NLP, and a gr...
11/23/2016

Fast Fourier Color Constancy

We present Fast Fourier Color Constancy (FFCC), a color constancy algori...

Code Repositories

color-describer

Code for Learning to Generate Compositional Color Descriptions


view repo