DSEC: A Stereo Event Camera Dataset for Driving Scenarios

03/10/2021
by   Mathias Gehrig, et al.
0

Once an academic venture, autonomous driving has received unparalleled corporate funding in the last decade. Still, the operating conditions of current autonomous cars are mostly restricted to ideal scenarios. This means that driving in challenging illumination conditions such as night, sunrise, and sunset remains an open problem. In these cases, standard cameras are being pushed to their limits in terms of low light and high dynamic range performance. To address these challenges, we propose, DSEC, a new dataset that contains such demanding illumination conditions and provides a rich set of sensory data. DSEC offers data from a wide-baseline stereo setup of two color frame cameras and two high-resolution monochrome event cameras. In addition, we collect lidar data and RTK GPS measurements, both hardware synchronized with all camera data. One of the distinctive features of this dataset is the inclusion of high-resolution event cameras. Event cameras have received increasing attention for their high temporal resolution and high dynamic range performance. However, due to their novelty, event camera datasets in driving scenarios are rare. This work presents the first high-resolution, large-scale stereo dataset with event cameras. The dataset contains 53 sequences collected by driving in a variety of illumination conditions and provides ground truth disparity for the development and evaluation of event-based stereo algorithms.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

research
01/28/2022

3D-FlowNet: Event-based optical flow estimation with 3D representation

Event-based cameras can overpass frame-based cameras limitations for imp...
research
06/02/2023

Temporal-controlled Frame Swap for Generating High-Fidelity Stereo Driving Data for Autonomy Analysis

This paper presents a novel approach, TeFS (Temporal-controlled Frame Sw...
research
03/28/2022

Are High-Resolution Event Cameras Really Needed?

Due to their outstanding properties in challenging conditions, event cam...
research
07/03/2022

Lasers to Events: Automatic Extrinsic Calibration of Lidars and Event Cameras

Despite significant academic and corporate efforts, autonomous driving u...
research
05/29/2023

Pedestrian detection with high-resolution event camera

Despite the dynamic development of computer vision algorithms, the imple...
research
09/18/2020

Holistic Grid Fusion Based Stop Line Estimation

Intersection scenarios provide the most complex traffic situations in Au...
research
03/01/2023

Event Fusion Photometric Stereo Network

We introduce a novel method to estimate surface normal of an object in a...

Please sign up or login with your details

Forgot password? Click here to reset