Learning by Stimulation Avoidance: A Principle to Control Spiking Neural Networks Dynamics

09/25/2016
by   Lana Sinapayen, et al.
0

Learning based on networks of real neurons, and by extension biologically inspired models of neural networks, has yet to find general learning rules leading to widespread applications. In this paper, we argue for the existence of a principle allowing to steer the dynamics of a biologically inspired neural network. Using carefully timed external stimulation, the network can be driven towards a desired dynamical state. We term this principle "Learning by Stimulation Avoidance" (LSA). We demonstrate through simulation that the minimal sufficient conditions leading to LSA in artificial networks are also sufficient to reproduce learning results similar to those obtained in biological neurons by Shahaf and Marom [1]. We examine the mechanism's basic dynamics in a reduced network, and demonstrate how it scales up to a network of 100 neurons. We show that LSA has a higher explanatory power than existing hypotheses about the response of biological neural networks to external simulation, and can be used as a learning rule for an embodied application: learning of wall avoidance by a simulated robot. The surge in popularity of artificial neural networks is mostly directed to disembodied models of neurons with biologically irrelevant dynamics: to the authors' knowledge, this is the first work demonstrating sensory-motor learning with random spiking networks through pure Hebbian learning.

READ FULL TEXT
research
01/27/2020

Neural Autopoiesis: Organizing Self-Boundary by Stimulus Avoidance in Biological and Artificial Neural Networks

Living organisms must actively maintain themselves in order to continue ...
research
03/12/2021

Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks

Inspired by more detailed modeling of biological neurons, Spiking neural...
research
06/15/2020

Equilibrium Propagation for Complete Directed Neural Networks

Artificial neural networks, one of the most successful approaches to sup...
research
02/11/2022

Motif-topology and Reward-learning improved Spiking Neural Network for Efficient Multi-sensory Integration

Network architectures and learning principles are key in forming complex...
research
11/12/2022

Motif-topology improved Spiking Neural Network for the Cocktail Party Effect and McGurk Effect

Network architectures and learning principles are playing key in forming...
research
03/08/2018

A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways

Many recent studies of the motor system are divided into two distinct ap...
research
10/27/2021

Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons

The response time of physical computational elements is finite, and neur...

Please sign up or login with your details

Forgot password? Click here to reset