DeepAI AI Chat
Log In Sign Up

Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection

by   Anthony Bisulco, et al.

This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs). We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm. Our system is composed of (i) a near-chip event filter that compresses and denoises the event stream from the DVS, and (ii) a Binary Neural Network (BNN) detection module that runs on a low-computation edge computing device (in our case a STM32F4 microcontroller). We present the system architecture and provide an end-to-end implementation for pedestrian detection in an office environment. Our implementation reduces transmission size by up to 99.6 transmitting the raw event stream. The average packet size in our system is only 1397 bits, while 307.2 kb are required to send an uncompressed DVS time window. Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83 system make it ideal for IoT applications.


page 1

page 2


Real-time HOG+SVM based object detection using SoC FPGA for a UHD video stream

Object detection is an essential component of many vision systems. For e...

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Accurate and efficient pedestrian detection is crucial for the intellige...

Naturalizing Neuromorphic Vision Event Streams Using GANs

Dynamic vision sensors are able to operate at high temporal resolutions ...

EarCough: Enabling Continuous Subject Cough Event Detection on Hearables

Cough monitoring can enable new individual pulmonary health applications...

Hardware architecture for high throughput event visual data filtering with matrix of IIR filters algorithm

Neuromorphic vision is a rapidly growing field with numerous application...

OmniDRL: Robust Pedestrian Detection using Deep Reinforcement Learning on Omnidirectional Cameras

Pedestrian detection is one of the most explored topics in computer visi...