Log In Sign Up

Learning Distributions of Meant Color

by   Lyndon White, et al.

When a speaker says the name of a color, the color they picture is not necessarily the same as the listener imagines. Color is a grounded semantic task, but that grounding is not a single value as the most recent works on color-generation do. Rather proper understanding of color language requires the capacity to map a sequence of words is to a distribution in color space. To achieve this, we propose a novel GRU based model which when given a color description such as "light greenish blue" produces an estimated probability distribution across HSV color space. This model learns the compositional functioning of each term: "light", "green", "ish" and "blue" in the color name, and show together they determine the shape of the distribution. This allows the prediction of distributions for color description phrases never seen in training. Such capacity is crucial in allowing human computer interaction systems to interpret vague color statements, with particular use in recognising objects described by color.


page 1

page 2

page 3

page 4


Learning to Generate Compositional Color Descriptions

The production of color language is essential for grounded language gene...

Grounding learning of modifier dynamics: An application to color naming

Grounding is crucial for natural language understanding. An important su...

Pragmatically Informative Color Generation by Grounding Contextual Modifiers

Grounding language in contextual information is crucial for fine-grained...

ABANICCO: A New Color Space for Multi-Label Pixel Classification and Color Segmentation

In any computer vision task involving color images, a necessary step is ...

Modeling Color Terminology Across Thousands of Languages

There is an extensive history of scholarship into what constitutes a "ba...

Inverse-Designed Meta-Optics with Spectral-Spatial Engineered Response to Mimic Color Perception

Meta-optics have rapidly become a major research field within the optics...

Generating Compositional Color Representations from Text

We consider the cross-modal task of producing color representations for ...