A Cognitively-Inspired Neural Architecture for Visual Abstract Reasoning Using Contrastive Perceptual and Conceptual Processing

by   Yuan Yang, et al.

We introduce a new neural architecture for solving visual abstract reasoning tasks inspired by human cognition, specifically by observations that human abstract reasoning often interleaves perceptual and conceptual processing as part of a flexible, iterative, and dynamic cognitive process. Inspired by this principle, our architecture models visual abstract reasoning as an iterative, self-contrasting learning process that pursues consistency between perceptual and conceptual processing of visual stimuli. We explain how this new Contrastive Perceptual-Conceptual Network (CPCNet) works using matrix reasoning problems in the style of the well-known Raven's Progressive Matrices intelligence test. Experiments on the machine learning dataset RAVEN show that CPCNet achieves higher accuracy than all previously published models while also using the weakest inductive bias. We also point out a substantial and previously unremarked class imbalance in the original RAVEN dataset, and we propose a new variant of RAVEN – AB-RAVEN – that is more balanced in terms of abstract concepts.


page 1

page 2

page 3

page 4


Learning to reason over visual objects

A core component of human intelligence is the ability to identify abstra...

Multi-Granularity Modularized Network for Abstract Visual Reasoning

Abstract visual reasoning connects mental abilities to the physical worl...

Abstract Visual Reasoning with Tangram Shapes

We introduce KiloGram, a resource for studying abstract visual reasoning...

Deep Non-Monotonic Reasoning for Visual Abstract Reasoning Tasks

While achieving unmatched performance on many well-defined tasks, deep l...

Multi-Label Contrastive Learning for Abstract Visual Reasoning

For a long time the ability to solve abstract reasoning tasks was consid...

Principles of perceptual grouping: implications for image-guided surgery

Gestalt theory has provided perceptual science with a conceptual framewo...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset