A Biologically Plausible Learning Rule for Perceptual Systems of organisms that Maximize Mutual Information

09/07/2021
by   Tao Liu, et al.
0

It is widely believed that the perceptual system of an organism is optimized for the properties of the environment to which it is exposed. A specific instance of this principle known as the Infomax principle holds that the purpose of early perceptual processing is to maximize the mutual information between the neural coding and the incoming sensory signal. In this article, we present a method to implement this principle accurately with a local, spike-based, and continuous-time learning rule.

READ FULL TEXT
research
09/14/2023

Estimating mutual information for spike trains: a bird song example

Zebra finch are a model animal used in the study of audition. They are a...
research
12/06/2017

Quantifying how much sensory information in a neural code is relevant for behavior

Determining how much of the sensory information carried by a neural code...
research
08/30/2023

Towards a Rigorous Analysis of Mutual Information in Contrastive Learning

Contrastive learning has emerged as a cornerstone in recent achievements...
research
04/12/2023

Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

Sensory perception (e.g. vision) relies on a hierarchy of cortical areas...
research
04/30/2020

An empirical study of computing with words approaches for multi-person and single-person systems

Computing with words (CWW) has emerged as a powerful tool for processing...
research
01/30/2023

Quantifying and maximizing the information flux in recurrent neural networks

Free-running Recurrent Neural Networks (RNNs), especially probabilistic ...
research
05/27/2021

Learning Structures for Deep Neural Networks

In this paper, we focus on the unsupervised setting for structure learni...

Please sign up or login with your details

Forgot password? Click here to reset