HSMD: An object motion detection algorithm using a Hybrid Spiking Neural Network Architecture

09/09/2021
by   Pedro Machado, et al.
11

The detection of moving objects is a trivial task performed by vertebrate retinas, yet a complex computer vision task. Object-motion-sensitive ganglion cells (OMS-GC) are specialised cells in the retina that sense moving objects. OMS-GC take as input continuous signals and produce spike patterns as output, that are transmitted to the Visual Cortex via the optic nerve. The Hybrid Sensitive Motion Detector (HSMD) algorithm proposed in this work enhances the GSOC dynamic background subtraction (DBS) algorithm with a customised 3-layer spiking neural network (SNN) that outputs spiking responses akin to the OMS-GC. The algorithm was compared against existing background subtraction (BS) approaches, available on the OpenCV library, specifically on the 2012 change detection (CDnet2012) and the 2014 change detection (CDnet2014) benchmark datasets. The results show that the HSMD was ranked overall first among the competing approaches and has performed better than all the other algorithms on four of the categories across all the eight test metrics. Furthermore, the HSMD proposed in this paper is the first to use an SNN to enhance an existing state of the art DBS (GSOC) algorithm and the results demonstrate that the SNN provides near real-time performance in realistic applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 7

page 10

page 11

page 12

research
12/12/2021

NeuroHSMD: Neuromorphic Hybrid Spiking Motion Detector

Vertebrate retinas are highly-efficient in processing trivial visual tas...
research
09/30/2022

A Novel Explainable Out-of-Distribution Detection Approach for Spiking Neural Networks

Research around Spiking Neural Networks has ignited during the last year...
research
12/17/2019

Deep SCNN-based Real-time Object Detection for Self-driving Vehicles Using LiDAR Temporal Data

Real-time accurate detection of three-dimensional (3D) objects is a fund...
research
03/12/2019

Spiking-YOLO: Spiking Neural Network for Real-time Object Detection

Over the past decade, deep neural networks (DNNs) have become a de-facto...
research
05/02/2022

Saliency map using features derived from spiking neural networks of primate visual cortex

We propose a framework inspired by biological vision systems to produce ...
research
05/29/2021

Foveal-pit inspired filtering of DVS spike response

In this paper, we present results of processing Dynamic Vision Sensor (D...
research
01/22/2018

An Improved LPTC Neural Model for Background Motion Direction Estimation

A class of specialized neurons, called lobula plate tangential cells (LP...

Please sign up or login with your details

Forgot password? Click here to reset