SpikE: spike-based embeddings for multi-relational graph data

04/27/2021
by   Dominik Dold, et al.
0

Despite the recent success of reconciling spike-based coding with the error backpropagation algorithm, spiking neural networks are still mostly applied to tasks stemming from sensory processing, operating on traditional data structures like visual or auditory data. A rich data representation that finds wide application in industry and research is the so-called knowledge graph - a graph-based structure where entities are depicted as nodes and relations between them as edges. Complex systems like molecules, social networks and industrial factory systems can be described using the common language of knowledge graphs, allowing the usage of graph embedding algorithms to make context-aware predictions in these information-packed environments. We propose a spike-based algorithm where nodes in a graph are represented by single spike times of neuron populations and relations as spike time differences between populations. Learning such spike-based embeddings only requires knowledge about spike times and spike time differences, compatible with recently proposed frameworks for training spiking neural networks. The presented model is easily mapped to current neuromorphic hardware systems and thereby moves inference on knowledge graphs into a domain where these architectures thrive, unlocking a promising industrial application area for this technology.

READ FULL TEXT

page 1

page 4

research
05/18/2022

Relational representation learning with spike trains

Relational representation learning has lately received an increase in in...
research
08/04/2022

Neuro-symbolic computing with spiking neural networks

Knowledge graphs are an expressive and widely used data structure due to...
research
10/04/2021

An energy-based model for neuro-symbolic reasoning on knowledge graphs

Machine learning on graph-structured data has recently become a major to...
research
09/21/2021

Learning through structure: towards deep neuromorphic knowledge graph embeddings

Computing latent representations for graph-structured data is an ubiquit...
research
08/15/2022

Scaling Up Dynamic Graph Representation Learning via Spiking Neural Networks

Recent years have seen a surge in research on dynamic graph representati...
research
09/05/2023

Information Processing by Neuron Populations in the Central Nervous System: Mathematical Structure of Data and Operations

In the intricate architecture of the mammalian central nervous system, n...
research
03/25/2019

Spike-based primitives for graph algorithms

In this paper we consider graph algorithms and graphical analysis as a n...

Please sign up or login with your details

Forgot password? Click here to reset