Revealing interpretable object representations from human behavior

01/09/2019
by   Charles Y. Zheng, et al.
6

To study how mental object representations are related to behavior, we estimated sparse, non-negative representations of objects using human behavioral judgments on images representative of 1,854 object categories. These representations predicted a latent similarity structure between objects, which captured most of the explainable variance in human behavioral judgments. Individual dimensions in the low-dimensional embedding were found to be highly reproducible and interpretable as conveying degrees of taxonomic membership, functionality, and perceptual attributes. We further demonstrated the predictive power of the embeddings for explaining other forms of human behavior, including categorization, typicality judgments, and feature ratings, suggesting that the dimensions reflect human conceptual representations of objects beyond the specific task.

READ FULL TEXT

page 6

page 7

page 14

page 15

page 16

research
05/02/2022

VICE: Variational Interpretable Concept Embeddings

A central goal in the cognitive sciences is the development of numerical...
research
06/22/2020

Understanding Object Affordances Through Verb Usage Patterns

In order to interact with objects in our environment, we rely on an unde...
research
09/07/2018

Using Sparse Semantic Embeddings Learned from Multimodal Text and Image Data to Model Human Conceptual Knowledge

Distributional models provide a convenient way to model semantics using ...
research
03/30/2023

A View From Somewhere: Human-Centric Face Representations

Few datasets contain self-identified sensitive attributes, inferring att...
research
03/31/2017

Transfer of View-manifold Learning to Similarity Perception of Novel Objects

We develop a model of perceptual similarity judgment based on re-trainin...
research
07/11/2022

Interpretability by design using computer vision for behavioral sensing in child and adolescent psychiatry

Observation is an essential tool for understanding and studying human be...
research
09/10/2020

Learning Behavioral Representations of Human Mobility

In this paper, we investigate the suitability of state-of-the-art repres...

Please sign up or login with your details

Forgot password? Click here to reset