Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

04/12/2023
by   Grégory Faye, et al.
0

Sensory perception (e.g. vision) relies on a hierarchy of cortical areas, in which neural activity propagates in both directions, to convey information not only about sensory inputs but also about cognitive states, expectations and predictions. At the macroscopic scale, neurophysiological experiments have described the corresponding neural signals as both forward and backward-travelling waves, sometimes with characteristic oscillatory signatures. It remains unclear, however, how such activity patterns relate to specific functional properties of the perceptual apparatus. Here, we present a mathematical framework, inspired by neural network models of predictive coding, to systematically investigate neural dynamics in a hierarchical perceptual system. We show that stability of the system can be systematically derived from the values of hyper-parameters controlling the different signals (related to bottom-up inputs, top-down prediction and error correction). Similarly, it is possible to determine in which direction, and at what speed neural activity propagates in the system. Different neural assemblies (reflecting distinct eigenvectors of the connectivity matrices) can simultaneously and independently display different properties in terms of stability, propagation speed or direction. We also derive continuous-limit versions of the system, both in time and in neural space. Finally, we analyze the possible influence of transmission delays between layers, and reveal the emergence of oscillations at biologically plausible frequencies.

READ FULL TEXT

page 11

page 13

page 14

page 16

page 20

page 27

page 39

page 41

research
06/04/2021

Predify: Augmenting deep neural networks with brain-inspired predictive coding dynamics

Deep neural networks excel at image classification, but their performanc...
research
06/08/2021

On the role of feedback in visual processing: a predictive coding perspective

Brain-inspired machine learning is gaining increasing consideration, par...
research
09/07/2021

A Biologically Plausible Learning Rule for Perceptual Systems of organisms that Maximize Mutual Information

It is widely believed that the perceptual system of an organism is optim...
research
04/05/2022

Hybrid Predictive Coding: Inferring, Fast and Slow

Predictive coding is an influential model of cortical neural activity. I...
research
10/28/2019

CTNN: Corticothalamic-inspired neural network

Sensory predictions by the brain in all modalities take place as a resul...
research
05/18/2023

The generalized Hierarchical Gaussian Filter

Hierarchical Bayesian models of perception and learning feature prominen...
research
09/05/2018

Hierarchical Selective Recruitment in Linear-Threshold Brain Networks - Part I: Intra-Layer Dynamics and Selective Inhibition

Goal-driven selective attention (GDSA) refers to the brain's function of...

Please sign up or login with your details

Forgot password? Click here to reset