Binding and Perspective Taking as Inference in a Generative Neural Network Model

12/09/2020
by   Mahdi Sadeghi, et al.
0

The ability to flexibly bind features into coherent wholes from different perspectives is a hallmark of cognition and intelligence. Importantly, the binding problem is not only relevant for vision but also for general intelligence, sensorimotor integration, event processing, and language. Various artificial neural network models have tackled this problem with dynamic neural fields and related approaches. Here we focus on a generative encoder-decoder architecture that adapts its perspective and binds features by means of retrospective inference. We first train a model to learn sufficiently accurate generative models of dynamic biological motion or other harmonic motion patterns, such as a pendulum. We then scramble the input to a certain extent, possibly vary the perspective onto it, and propagate the prediction error back onto a binding matrix, that is, hidden neural states that determine feature binding. Moreover, we propagate the error further back onto perspective taking neurons, which rotate and translate the input features onto a known frame of reference. Evaluations show that the resulting gradient-based inference process solves the perspective taking and binding problem for known biological motion patterns, essentially yielding a Gestalt perception mechanism. In addition, redundant feature properties and population encodings are shown to be highly useful. While we evaluate the algorithm on biological motion patterns, the principled approach should be applicable to binding and Gestalt perception problems in other domains.

READ FULL TEXT
research
06/01/2022

Binding Dancers Into Attractors

To effectively perceive and process observations in our environment, fea...
research
04/03/2019

Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review

Motion perception is a critical capability determining a variety of aspe...
research
11/09/2015

Biologically Inspired Dynamic Textures for Probing Motion Perception

Perception is often described as a predictive process based on an optima...
research
11/30/2021

Deep Auto-encoder with Neural Response

Artificial intelligence and neuroscience are deeply interactive. Artific...
research
06/18/2020

An adversarial algorithm for variational inference with a new role for acetylcholine

Sensory learning in the mammalian cortex has long been hypothesized to i...
research
02/21/2018

Building Efficient ConvNets using Redundant Feature Pruning

This paper presents an efficient technique to prune deep and/or wide con...
research
11/04/2020

A deep learning classifier for local ancestry inference

Local ancestry inference (LAI) identifies the ancestry of each segment o...

Please sign up or login with your details

Forgot password? Click here to reset