A thermodynamically consistent chemical spiking neuron capable of autonomous Hebbian learning

09/28/2020
by   Jakub Fil, et al.
12

We propose a fully autonomous, thermodynamically consistent set of chemical reactions that implements a spiking neuron. This chemical neuron is able to learn input patterns in a Hebbian fashion. The system is scalable to arbitrarily many input channels. We demonstrate its performance in learning frequency biases in the input as well as correlations between different input channels. Efficient computation of time-correlations requires a highly non-linear activation function. The resource requirements of a non-linear activation function are discussed. In addition to the thermodynamically consistent model of the CN, we also propose a biologically plausible version that could be engineered in a synthetic biology context.

READ FULL TEXT

page 5

page 10

research
05/09/2022

Programming molecular systems to emulate a learning spiking neuron

Hebbian theory seeks to explain how the neurons in the brain adapt to st...
research
11/23/2020

IC Neuron: An Efficient Unit to Construct Neural Networks

As a popular machine learning method, neural networks can be used to sol...
research
11/06/2019

A Numerical Study of the Time of Extinction in a Class of Systems of Spiking Neurons

In this paper we present a numerical study of a mathematical model of sp...
research
04/08/2016

Norm-preserving Orthogonal Permutation Linear Unit Activation Functions (OPLU)

We propose a novel activation function that implements piece-wise orthog...
research
03/31/2017

Noisy Softplus: an activation function that enables SNNs to be trained as ANNs

We extended the work of proposed activation function, Noisy Softplus, to...
research
12/07/2017

Solving internal covariate shift in deep learning with linked neurons

This work proposes a novel solution to the problem of internal covariate...
research
05/22/2018

Breaking the Activation Function Bottleneck through Adaptive Parameterization

Standard neural network architectures are non-linear only by virtue of a...

Please sign up or login with your details

Forgot password? Click here to reset