Transferring dense object detection models to event-based data

10/05/2022
by   Vincenz Mechler, et al.
0

Event-based image representations are fundamentally different to traditional dense images. This poses a challenge to apply current state-of-the-art models for object detection as they are designed for dense images. In this work we evaluate the YOLO object detection model on event data. To this end we replace dense-convolution layers by either sparse convolutions or asynchronous sparse convolutions which enables direct processing of event-based images and compare the performance and runtime to feeding event-histograms into dense-convolutions. Here, hyper-parameters are shared across all variants to isolate the effect sparse-representation has on detection performance. At this, we show that current sparse-convolution implementations cannot translate their theoretical lower computation requirements into an improved runtime.

READ FULL TEXT

page 1

page 7

page 8

research
01/07/2018

SBNet: Sparse Blocks Network for Fast Inference

Conventional deep convolutional neural networks (CNNs) apply convolution...
research
04/12/2012

Simultaneous Object Detection, Tracking, and Event Recognition

The common internal structure and algorithmic organization of object det...
research
11/22/2022

Pushing the Limits of Asynchronous Graph-based Object Detection with Event Cameras

State-of-the-art machine-learning methods for event cameras treat events...
research
07/24/2023

Automotive Object Detection via Learning Sparse Events by Temporal Dynamics of Spiking Neurons

Event-based sensors, with their high temporal resolution (1us) and dynam...
research
04/26/2023

From Chaos Comes Order: Ordering Event Representations for Object Detection

Today, state-of-the-art deep neural networks that process events first c...
research
08/27/2018

Smoothed Dilated Convolutions for Improved Dense Prediction

Dilated convolutions, also known as atrous convolutions, have been widel...
research
07/26/2023

Memory-Efficient Graph Convolutional Networks for Object Classification and Detection with Event Cameras

Recent advances in event camera research emphasize processing data in it...

Please sign up or login with your details

Forgot password? Click here to reset