Context Matters: A Theory of Semantic Discriminability for Perceptual Encoding Systems

08/08/2021
by   Kushin Mukherjee, et al.
0

People's associations between colors and concepts influence their ability to interpret the meanings of colors in information visualizations. Previous work has suggested such effects are limited to concepts that have strong, specific associations with colors. However, although a concept may not be strongly associated with any colors, its mapping can be disambiguated in the context of other concepts in an encoding system. We articulate this view in semantic discriminability theory, a general framework for understanding conditions determining when people can infer meaning from perceptual features. Semantic discriminability is the degree to which observers can infer a unique mapping between visual features and concepts. Semantic discriminability theory posits that the capacity for semantic discriminability for a set of concepts is constrained by the difference between the feature-concept association distributions across the concepts in the set. We define formal properties of this theory and test its implications in two experiments. The results show that the capacity to produce semantically discriminable colors for sets of concepts was indeed constrained by the statistical distance between color-concept association distributions (Experiment 1). Moreover, people could interpret meanings of colors in bar graphs insofar as the colors were semantically discriminable, even for concepts previously considered "non-colorable" (Experiment 2). The results suggest that colors are more robust for visual communication than previously thought.

READ FULL TEXT

page 9

page 11

page 14

page 15

research
09/07/2020

Semantic Discriminability for Visual Communication

To interpret information visualizations, observers must determine how vi...
research
08/01/2019

Estimating Color-Concept Associations from Image Statistics

To interpret the meanings of colors in visualizations of categorical inf...
research
09/06/2022

Unifying Effects of Direct and Relational Associations for Visual Communication

People have expectations about how colors map to concepts in visualizati...
research
01/11/2021

Learning Semantically Meaningful Features for Interpretable Classifications

Learning semantically meaningful features is important for Deep Neural N...
research
11/29/2019

Color inference from semantic labeling for person search in videos

We propose an explainable model to generate semantic color labels for pe...
research
08/31/2023

Effects of data distribution and granularity on color semantics for colormap data visualizations

To create effective data visualizations, it helps to represent data usin...
research
06/03/2019

An Information-Theoretical Approach to the Information Capacity and Cost-Effectiveness Evaluation of Color Palettes

Colors are used as effective tools of representing and transferring info...

Please sign up or login with your details

Forgot password? Click here to reset