DeepAI AI Chat
Log In Sign Up

Modeling Human Categorization of Natural Images Using Deep Feature Representations

by   Ruairidh M. Battleday, et al.
berkeley college

Over the last few decades, psychologists have developed sophisticated formal models of human categorization using simple artificial stimuli. In this paper, we use modern machine learning methods to extend this work into the realm of naturalistic stimuli, enabling human categorization to be studied over the complex visual domain in which it evolved and developed. We show that representations derived from a convolutional neural network can be used to model behavior over a database of >300,000 human natural image classifications, and find that a group of models based on these representations perform well, near the reliability of human judgments. Interestingly, this group includes both exemplar and prototype models, contrasting with the dominance of exemplar models in previous work. We are able to improve the performance of the remaining models by preprocessing neural network representations to more closely capture human similarity judgments.


page 4

page 7

page 10


Capturing human categorization of natural images at scale by combining deep networks and cognitive models

Human categorization is one of the most important and successful targets...

Leveraging deep neural networks to capture psychological representations

Artificial neural networks have seen a recent surge in popularity for th...

Learning Hierarchical Visual Representations in Deep Neural Networks Using Hierarchical Linguistic Labels

Modern convolutional neural networks (CNNs) are able to achieve human-le...

Capturing human category representations by sampling in deep feature spaces

Understanding how people represent categories is a core problem in cogni...

Taking a machine's perspective: Human deciphering of adversarial images

How similar is the human mind to the sophisticated machine-learning syst...

Early Salient Region Selection Does Not Drive Rapid Visual Categorization

The current dominant visual processing paradigm in both human and machin...