Speed Invariant Time Surface for Learning to Detect Corner Points with Event-Based Cameras

03/27/2019
by   Jacques Manderscheid, et al.
0

We propose a learning approach to corner detection for event-based cameras that is stable even under fast and abrupt motions. Event-based cameras offer high temporal resolution, power efficiency, and high dynamic range. However, the properties of event-based data are very different compared to standard intensity images, and simple extensions of corner detection methods designed for these images do not perform well on event-based data. We first introduce an efficient way to compute a time surface that is invariant to the speed of the objects. We then show that we can train a Random Forest to recognize events generated by a moving corner from our time surface. Random Forests are also extremely efficient, and therefore a good choice to deal with the high capture frequency of event-based cameras ---our implementation processes up to 1.6Mev/s on a single CPU. Thanks to our time surface formulation and this learning approach, our method is significantly more robust to abrupt changes of direction of the corners compared to previous ones. Our method also naturally assigns a confidence score for the corners, which can be useful for postprocessing. Moreover, we introduce a high-resolution dataset suitable for quantitative evaluation and comparison of corner detection methods for event-based cameras. We call our approach SILC, for Speed Invariant Learned Corners, and compare it to the state-of-the-art with extensive experiments, showing better performance.

READ FULL TEXT

page 1

page 3

page 5

page 8

research
05/24/2021

luvHarris: A Practical Corner Detector for Event-cameras

There have been a number of corner detection methods proposed for event ...
research
11/01/2018

Continuous-time Intensity Estimation Using Event Cameras

Event cameras provide asynchronous, data-driven measurements of local te...
research
09/27/2022

Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera

Non-line-of-sight (NLOS) imaging is an emerging technique for detecting ...
research
11/15/2017

Velocity variations at Columbia Glacier captured by particle filtering of oblique time-lapse images

We develop a probabilistic method for tracking glacier surface motion ba...
research
12/20/2021

Real-Time Optical Flow for Vehicular Perception with Low- and High-Resolution Event Cameras

Event cameras capture changes of illumination in the observed scene rath...
research
11/22/2022

Event Transformer+. A multi-purpose solution for efficient event data processing

Event cameras record sparse illumination changes with high temporal reso...
research
04/02/2023

SoftED: Metrics for Soft Evaluation of Time Series Event Detection

Time series event detection methods are evaluated mainly by standard cla...

Please sign up or login with your details

Forgot password? Click here to reset