Grounding learning of modifier dynamics: An application to color naming

09/17/2019
by   Xudong Han, et al.
0

Grounding is crucial for natural language understanding. An important subtask is to understand modified color expressions, such as 'dirty blue'. We present a model of color modifiers that, compared with previous additive models in RGB space, learns more complex transformations. In addition, we present a model that operates in the HSV color space. We show that certain adjectives are better modeled in that space. To account for all modifiers, we train a hard ensemble model that selects a color space depending on the modifier color pair. Experimental results show significant and consistent improvements compared to the state-of-the-art baseline model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/09/2020

Pragmatically Informative Color Generation by Grounding Contextual Modifiers

Grounding language in contextual information is crucial for fine-grained...
research
09/27/2017

Learning Distributions of Meant Color

When a speaker says the name of a color, the color they picture is not n...
research
09/30/2022

Generative Model Watermarking Based on Human Visual System

Intellectual property protection of deep neural networks is receiving at...
research
08/01/2013

Calculation reduction method for color computer-generated hologram using color space conversion

We report a calculation reduction method for color computer-generated ho...
research
09/04/2010

Fast Color Space Transformations Using Minimax Approximations

Color space transformations are frequently used in image processing, gra...
research
09/13/2021

Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color

Pretrained language models have been shown to encode relational informat...

Please sign up or login with your details

Forgot password? Click here to reset