Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

06/30/2021
by   Mingkun Xu, et al.
0

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking neural networks (SNNs) for handling Euclidean-space tasks, it still remains challenging to exploit SNNs in processing non-Euclidean-space data represented by graph data, mainly due to the lack of effective modeling framework and useful training techniques. Here we present a general spike-based modeling framework that enables the direct training of SNNs for graph learning. Through spatial-temporal unfolding for spiking data flows of node features, we incorporate graph convolution filters into spiking dynamics and formalize a synergistic learning paradigm. Considering the unique features of spike representation and spiking dynamics, we propose a spatial-temporal feature normalization (STFN) technique suitable for SNN to accelerate convergence. We instantiate our methods into two spiking graph models, including graph convolution SNNs and graph attention SNNs, and validate their performance on three node-classification benchmarks, including Cora, Citeseer, and Pubmed. Our model can achieve comparable performance with the state-of-the-art graph neural network (GNN) models with much lower computation costs, demonstrating great benefits for the execution on neuromorphic hardware and prompting neuromorphic applications in graphical scenarios.

READ FULL TEXT
research
02/19/2020

Exploiting Neuron and Synapse Filter Dynamics in Spatial Temporal Learning of Deep Spiking Neural Network

The recent discovered spatial-temporal information processing capability...
research
03/25/2019

Spike-based primitives for graph algorithms

In this paper we consider graph algorithms and graphical analysis as a n...
research
08/15/2022

Scaling Up Dynamic Graph Representation Learning via Spiking Neural Networks

Recent years have seen a surge in research on dynamic graph representati...
research
06/21/2022

TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks

Spiking Neural Networks (SNNs) is a practical approach toward more data-...
research
05/05/2022

Spiking Graph Convolutional Networks

Graph Convolutional Networks (GCNs) achieve an impressive performance du...
research
08/03/2020

Spiking neuromorphic chip learns entangled quantum states

Neuromorphic systems are designed to emulate certain structural and dyna...

Please sign up or login with your details

Forgot password? Click here to reset