Affordances Provide a Fundamental Categorization Principle for Visual Scenes

11/19/2014
by   Michelle R. Greene, et al.
0

How do we know that a kitchen is a kitchen by looking? Relatively little is known about how we conceptualize and categorize different visual environments. Traditional models of visual perception posit that scene categorization is achieved through the recognition of a scene's objects, yet these models cannot account for the mounting evidence that human observers are relatively insensitive to the local details in an image. Psychologists have long theorized that the affordances, or actionable possibilities of a stimulus are pivotal to its perception. To what extent are scene categories created from similar affordances? Using a large-scale experiment using hundreds of scene categories, we show that the activities afforded by a visual scene provide a fundamental categorization principle. Affordance-based similarity explained the majority of the structure in the human scene categorization patterns, outperforming alternative similarities based on objects or visual features. We all models were combined, affordances provided the majority of the predictive power in the combined model, and nearly half of the total explained variance is captured only by affordances. These results challenge many existing models of high-level visual perception, and provide immediately testable hypotheses for the functional organization of the human perceptual system.

READ FULL TEXT

page 4

page 6

page 8

page 10

page 14

research
03/10/2021

An Image-based Approach of Task-driven Driving Scene Categorization

Categorizing driving scenes via visual perception is a key technology fo...
research
06/03/2016

How Deep is the Feature Analysis underlying Rapid Visual Categorization?

Rapid categorization paradigms have a long history in experimental psych...
research
11/21/2018

An Interpretable Model for Scene Graph Generation

We propose an efficient and interpretable scene graph generator. We cons...
research
01/25/2019

Visual Categorization of Objects into Animal and Plant Classes Using Global Shape Descriptors

How humans can distinguish between general categories of objects? Are th...
research
02/07/2023

Structured Generative Models for Scene Understanding

This position paper argues for the use of structured generative models (...
research
03/04/2019

Optimizing Object-based Perception and Control by Free-Energy Principle

One of the well-known formulations of human perception is a hierarchical...
research
03/27/2013

Machine Generalization and Human Categorization: An Information-Theoretic View

In designing an intelligent system that must be able to explain its reas...

Please sign up or login with your details

Forgot password? Click here to reset