Event-based YOLO Object Detection: Proof of Concept for Forward Perception System

12/14/2022
by   Waseem Shariff, et al.
0

Neuromorphic vision or event vision is an advanced vision technology, where in contrast to the visible camera that outputs pixels, the event vision generates neuromorphic events every time there is a brightness change which exceeds a specific threshold in the field of view (FOV). This study focuses on leveraging neuromorphic event data for roadside object detection. This is a proof of concept towards building artificial intelligence (AI) based pipelines which can be used for forward perception systems for advanced vehicular applications. The focus is on building efficient state-of-the-art object detection networks with better inference results for fast-moving forward perception using an event camera. In this article, the event-simulated A2D2 dataset is manually annotated and trained on two different YOLOv5 networks (small and large variants). To further assess its robustness, single model testing and ensemble model testing are carried out.

READ FULL TEXT

page 3

page 5

page 6

research
04/28/2020

Event-based Robotic Grasping Detection with Neuromorphic Vision Sensor and Event-Stream Dataset

Robotic grasping plays an important role in the field of robotics. The c...
research
05/21/2018

Event-based Convolutional Networks for Object Detection in Neuromorphic Cameras

Event-based cameras are bioinspired sensors able to perceive changes in ...
research
05/04/2023

Neuromorphic Sensing for Yawn Detection in Driver Drowsiness

Driver monitoring systems (DMS) are a key component of vehicular safety ...
research
02/26/2020

Inceptive Event Time-Surfaces for Object Classification Using Neuromorphic Cameras

This paper presents a novel fusion of low-level approaches for dimension...
research
07/25/2023

Decisive Data using Multi-Modality Optical Sensors for Advanced Vehicular Systems

Optical sensors have played a pivotal role in acquiring real world data ...
research
04/15/2016

Invariant feature extraction from event based stimuli

We propose a novel architecture, the event-based GASSOM for learning and...
research
05/27/2021

How saccadic vision might help with theinterpretability of deep networks

We describe how some problems (interpretability,lack of object-orientedn...

Please sign up or login with your details

Forgot password? Click here to reset