HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classification

03/21/2018
by   Amos Sironi, et al.
0

Event-based cameras have recently drawn the attention of the Computer Vision community thanks to their advantages in terms of high temporal resolution, low power consumption and high dynamic range, compared to traditional frame-based cameras. These properties make event-based cameras an ideal choice for autonomous vehicles, robot navigation or UAV vision, among others. However, the accuracy of event-based object classification algorithms, which is of crucial importance for any reliable system working in real-world conditions, is still far behind their frame-based counterparts. Two main reasons for this performance gap are: 1. The lack of effective low-level representations and architectures for event-based object classification and 2. The absence of large real-world event-based datasets. In this paper we address both problems. First, we introduce a novel event-based feature representation together with a new machine learning architecture. Compared to previous approaches, we use local memory units to efficiently leverage past temporal information and build a robust event-based representation. Second, we release the first large real-world event-based dataset for object classification. We compare our method to the state-of-the-art with extensive experiments, showing better classification performance and real-time computation.

READ FULL TEXT

page 1

page 7

research
04/24/2019

PCA-RECT: An Energy-efficient Object Detection Approach for Event Cameras

We present the first purely event-based, energy-efficient approach for o...
research
09/28/2020

Learning to Detect Objects with a 1 Megapixel Event Camera

Event cameras encode visual information with high temporal precision, lo...
research
03/23/2022

Autofocus for Event Cameras

Focus control (FC) is crucial for cameras to capture sharp images in cha...
research
06/01/2021

EV-VGCNN: A Voxel Graph CNN for Event-based Object Classification

Event cameras report sparse intensity changes and hold noticeable advant...
research
09/10/2022

Real-time event simulation with frame-based cameras

Event cameras are becoming increasingly popular in robotics and computer...
research
03/16/2019

Spatiotemporal Feature Learning for Event-Based Vision

Unlike conventional frame-based sensors, event-based visual sensors outp...
research
10/02/2017

Learning event representation: As sparse as possible, but not sparser

Selecting an optimal event representation is essential for event classif...

Please sign up or login with your details

Forgot password? Click here to reset