Computing threshold functions using dendrites

11/10/2016
by   Romain Cazé, et al.
0

Neurons, modeled as linear threshold unit (LTU), can in theory compute all thresh- old functions. In practice, however, some of these functions require synaptic weights of arbitrary large precision. We show here that dendrites can alleviate this requirement. We introduce here the non-Linear Threshold Unit (nLTU) that integrates synaptic input sub-linearly within distinct subunits to take into account local saturation in dendrites. We systematically search parameter space of the nTLU and TLU to compare them. Firstly, this shows that the nLTU can compute all threshold functions with smaller precision weights than the LTU. Secondly, we show that a nLTU can compute significantly more functions than a LTU when an input can only make a single synapse. This work paves the way for a new generation of network made of nLTU with binary synapses.

READ FULL TEXT
research
07/08/2020

Asymptotics of the number of 2-threshold functions

A k-threshold function on a rectangular grid of size m × n is the conjun...
research
05/22/2018

Reducing Parameter Space for Neural Network Training

For neural networks (NNs) with rectified linear unit (ReLU) or binary ac...
research
01/02/2019

The capacity of feedforward neural networks

A long standing open problem in the theory of neural networks is the dev...
research
04/12/2018

On linear codes and distinct weights

We provide a construction for linear codes attaining the maximum possibl...
research
07/12/2018

On the Approximation Resistance of Balanced Linear Threshold Functions

In this paper, we show that there exists a balanced linear threshold fun...
research
03/30/2021

Training Sparse Neural Network by Constraining Synaptic Weight on Unit Lp Sphere

Sparse deep neural networks have shown their advantages over dense model...
research
02/02/2023

OpenSpike: An OpenRAM SNN Accelerator

This paper presents a spiking neural network (SNN) accelerator made usin...

Please sign up or login with your details

Forgot password? Click here to reset