Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processing

07/15/2022
by   Ahsan Adeel, et al.
3

There is ample neurobiological evidence that context-sensitive neocortical neurons use their apical inputs as context to amplify the transmission of coherent feedforward (FF) inputs. However, it has not been demonstrated until now how this mechanism can provide useful neural computation. Here we show for the first time that the processing and learning capabilities of this form of neural information processing are well-matched to the abilities of mammalian neocortex. Specifically, we show that a network composed of such local processors restricts the transmission of conflicting information to higher levels and greatly reduces the amount of activity required to process large amounts of heterogeneous real-world data e.g., when processing audiovisual speech, these processors use seen lip movements to selectively amplify FF transmission of the auditory information that those movements generate and vice versa. As this mechanism is shown to be over 1250X more efficient (per FF transmission) than the best available forms of deep neural nets, it offers a step-change in understanding the brain's mysterious energy-saving mechanism and inspires advances in designing enhanced forms of biologically plausible machine learning algorithms.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 8

research
03/15/2018

Contrasting information theoretic decompositions of modulatory and arithmetic interactions in neural information processing systems

Biological and artificial neural systems are composed of many local proc...
research
01/25/2019

Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets

The way how recurrently connected networks of spiking neurons in the bra...
research
10/23/2020

Lamina-specific neuronal properties promote robust, stable signal propagation in feedforward networks

Feedforward networks (FFN) are ubiquitous structures in neural systems a...
research
10/23/2020

A simple normative network approximates local non-Hebbian learning in the cortex

To guide behavior, the brain extracts relevant features from high-dimens...
research
08/21/2018

Backpropagation and Biological Plausibility

By and large, Backpropagation (BP) is regarded as one of the most import...
research
05/16/2023

Cooperation Is All You Need

Going beyond 'dendritic democracy', we introduce a 'democracy of local p...
research
05/18/2015

Advances in Artificial Intelligence: Deep Intentions, Shallow Achievements

Over the past decade, AI has made a remarkable progress due to recently ...

Please sign up or login with your details

Forgot password? Click here to reset