Revealing interpretable object representations from human behavior

01/09/2019
by   Charles Y. Zheng, et al.
6

To study how mental object representations are related to behavior, we estimated sparse, non-negative representations of objects using human behavioral judgments on images representative of 1,854 object categories. These representations predicted a latent similarity structure between objects, which captured most of the explainable variance in human behavioral judgments. Individual dimensions in the low-dimensional embedding were found to be highly reproducible and interpretable as conveying degrees of taxonomic membership, functionality, and perceptual attributes. We further demonstrated the predictive power of the embeddings for explaining other forms of human behavior, including categorization, typicality judgments, and feature ratings, suggesting that the dimensions reflect human conceptual representations of objects beyond the specific task.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 7

page 14

page 15

page 16

05/02/2022

VICE: Variational Interpretable Concept Embeddings

A central goal in the cognitive sciences is the development of computati...
06/22/2020

Understanding Object Affordances Through Verb Usage Patterns

In order to interact with objects in our environment, we rely on an unde...
09/07/2018

Using Sparse Semantic Embeddings Learned from Multimodal Text and Image Data to Model Human Conceptual Knowledge

Distributional models provide a convenient way to model semantics using ...
03/31/2017

Transfer of View-manifold Learning to Similarity Perception of Novel Objects

We develop a model of perceptual similarity judgment based on re-trainin...
09/10/2020

Learning Behavioral Representations of Human Mobility

In this paper, we investigate the suitability of state-of-the-art repres...
10/13/2020

Transforming Neural Network Visual Representations to Predict Human Judgments of Similarity

Deep-learning vision models have shown intriguing similarities and diffe...
10/05/2018

Predicting and Explaining Behavioral Data with Structured Feature Space Decomposition

Modeling human behavioral data is challenging due to its scale, sparsene...

Code Repositories

brainwave-podcast

util for the best yt show of all time


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.