Function Regression using Spiking DeepONet

05/17/2022
by   Adar Kahana, et al.
8

One of the main broad applications of deep learning is function regression. However, despite their demonstrated accuracy and robustness, modern neural network architectures require heavy computational resources to train. One method to mitigate or even resolve this inefficiency has been to draw further inspiration from the brain and reformulate the learning process in a more biologically-plausible way, developing what are known as Spiking Neural Networks (SNNs), which have been gaining traction in recent years. In this paper we present an SNN-based method to perform regression, which has been a challenge due to the inherent difficulty in representing a function's input domain and continuous output values as spikes. We use a DeepONet - neural network designed to learn operators - to learn the behavior of spikes. Then, we use this approach to do function regression. We propose several methods to use a DeepONet in the spiking framework, and present accuracy and training time for different benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/30/2023

Sparsifying Spiking Networks through Local Rhythms

It has been well-established that within conventional neural networks, m...
research
09/27/2021

Training Spiking Neural Networks Using Lessons From Deep Learning

The brain is the perfect place to look for inspiration to develop more e...
research
09/16/2021

Deep Spiking Neural Networks with Resonate-and-Fire Neurons

In this work, we explore a new Spiking Neural Network (SNN) formulation ...
research
02/07/2018

Going Deeper in Spiking Neural Networks: VGG and Residual Architectures

Over the past few years, Spiking Neural Networks (SNNs) have become popu...
research
05/31/2023

Direct Learning-Based Deep Spiking Neural Networks: A Review

The spiking neural network (SNN), as a promising brain-inspired computat...
research
03/23/2020

Inherent Adversarial Robustness of Deep Spiking Neural Networks: Effects of Discrete Input Encoding and Non-Linear Activations

In the recent quest for trustworthy neural networks, we present Spiking ...
research
11/12/2022

Motif-topology improved Spiking Neural Network for the Cocktail Party Effect and McGurk Effect

Network architectures and learning principles are playing key in forming...

Please sign up or login with your details

Forgot password? Click here to reset