A Spike Learning System for Event-driven Object Recognition

01/21/2021
by   Shibo Zhou, et al.
0

Event-driven sensors such as LiDAR and dynamic vision sensor (DVS) have found increased attention in high-resolution and high-speed applications. A lot of work has been conducted to enhance recognition accuracy. However, the essential topic of recognition delay or time efficiency is largely under-explored. In this paper, we present a spiking learning system that uses the spiking neural network (SNN) with a novel temporal coding for accurate and fast object recognition. The proposed temporal coding scheme maps each event's arrival time and data into SNN spike time so that asynchronously-arrived events are processed immediately without delay. The scheme is integrated nicely with the SNN's asynchronous processing capability to enhance time efficiency. A key advantage over existing systems is that the event accumulation time for each recognition task is determined automatically by the system rather than pre-set by the user. The system can finish recognition early without waiting for all the input events. Extensive experiments were conducted over a list of 7 LiDAR and DVS datasets. The results demonstrated that the proposed system had state-of-the-art recognition accuracy while achieving remarkable time efficiency. Recognition delay was shown to reduce by 56.3 experiment settings over the popular KITTI dataset.

READ FULL TEXT
research
01/24/2020

Temporal Pulses Driven Spiking Neural Network for Fast Object Recognition in Autonomous Driving

Accurate real-time object recognition from sensory data has long been a ...
research
10/29/2018

Object Detection based on LIDAR Temporal Pulses using Spiking Neural Networks

Neural networks has been successfully used in the processing of Lidar da...
research
11/19/2019

Unsupervised AER Object Recognition Based on Multiscale Spatio-Temporal Features and Spiking Neurons

This paper proposes an unsupervised address event representation (AER) o...
research
07/24/2023

Automotive Object Detection via Learning Sparse Events by Temporal Dynamics of Spiking Neurons

Event-based sensors, with their high temporal resolution (1us) and dynam...
research
02/07/2022

T-NGA: Temporal Network Grafting Algorithm for Learning to Process Spiking Audio Sensor Events

Spiking silicon cochlea sensors encode sound as an asynchronous stream o...
research
06/13/2013

The Ripple Pond: Enabling Spiking Networks to See

In this paper we present the biologically inspired Ripple Pond Network (...
research
11/09/2021

Unsupervised Spiking Instance Segmentation on Event Data using STDP

Spiking Neural Networks (SNN) and the field of Neuromorphic Engineering ...

Please sign up or login with your details

Forgot password? Click here to reset