Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection

04/03/2020
by   Anthony Bisulco, et al.
0

This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs). We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm. Our system is composed of (i) a near-chip event filter that compresses and denoises the event stream from the DVS, and (ii) a Binary Neural Network (BNN) detection module that runs on a low-computation edge computing device (in our case a STM32F4 microcontroller). We present the system architecture and provide an end-to-end implementation for pedestrian detection in an office environment. Our implementation reduces transmission size by up to 99.6 transmitting the raw event stream. The average packet size in our system is only 1397 bits, while 307.2 kb are required to send an uncompressed DVS time window. Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83 system make it ideal for IoT applications.

READ FULL TEXT

page 1

page 2

research
04/13/2023

Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipeline

Edge computing solutions that enable the extraction of high level inform...
research
04/22/2022

Real-time HOG+SVM based object detection using SoC FPGA for a UHD video stream

Object detection is an essential component of many vision systems. For e...
research
08/15/2023

Neuromorphic Seatbelt State Detection for In-Cabin Monitoring with Event Cameras

Neuromorphic vision sensors, or event cameras, differ from conventional ...
research
12/09/2021

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Accurate and efficient pedestrian detection is crucial for the intellige...
research
03/18/2023

EarCough: Enabling Continuous Subject Cough Event Detection on Hearables

Cough monitoring can enable new individual pulmonary health applications...
research
07/26/2023

High-definition event frame generation using SoC FPGA devices

In this paper we have addressed the implementation of the accumulation a...
research
05/15/2020

Resisting the Distracting-factors in Pedestrian Detection

Pedestrian detection has been heavily studied in the last decade due to ...

Please sign up or login with your details

Forgot password? Click here to reset