Event Guided Depth Sensing

by   Manasi Muglikar, et al.

Active depth sensors like structured light, lidar, and time-of-flight systems sample the depth of the entire scene uniformly at a fixed scan rate. This leads to limited spatio-temporal resolution where redundant static information is over-sampled and precious motion information might be under-sampled. In this paper, we present an efficient bio-inspired event-camera-driven depth estimation algorithm. In our approach, we dynamically illuminate areas of interest densely, depending on the scene activity detected by the event camera, and sparsely illuminate areas in the field of view with no motion. The depth estimation is achieved by an event-based structured light system consisting of a laser point projector coupled with a second event-based sensor tuned to detect the reflection of the laser from the scene. We show the feasibility of our approach in a simulated autonomous driving scenario and real indoor sequences using our prototype. We show that, in natural scenes like autonomous driving and indoor environments, moving edges correspond to less than 10 the scene on average. Thus our setup requires the sensor to scan only 10 the scene, which could lead to almost 90 illumination source. While we present the evaluation and proof-of-concept for an event-based structured-light system, the ideas presented here are applicable for a wide range of depth-sensing modalities like LIDAR, time-of-flight, and standard stereo.


page 5

page 6

page 8


ESL: Event-based Structured Light

Event cameras are bio-inspired sensors providing significant advantages ...

LEAD: LiDAR Extender for Autonomous Driving

3D perception using sensors under vehicle industrial standard is the rig...

Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes

Depth estimation, as a necessary clue to convert 2D images into the 3D s...

Is my Depth Ground-Truth Good Enough? HAMMER – Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regression

Depth estimation is a core task in 3D computer vision. Recent methods in...

Event-Based Structured Light for Depth Reconstruction using Frequency Tagged Light Patterns

This paper presents a new method for 3D depth estimation using the outpu...

Near Field iToF LIDAR Depth Improvement from Limited Number of Shots

Indirect Time of Flight LiDARs can indirectly calculate the scene's dept...

Depth Sensing Beyond LiDAR Range

Depth sensing is a critical component of autonomous driving technologies...

Please sign up or login with your details

Forgot password? Click here to reset