Semi-Dense 3D Reconstruction with a Stereo Event Camera

07/19/2018
by   Yi Zhou, et al.
6

Event cameras are bio-inspired sensors that offer several advantages, such as low latency, high-speed and high dynamic range, to tackle challenging scenarios in computer vision. This paper presents a solution to the problem of 3D reconstruction from data captured by a stereo event-camera rig moving in a static scene, such as in the context of stereo Simultaneous Localization and Mapping. The proposed method consists of the optimization of an energy function designed to exploit small-baseline spatio-temporal consistency of events triggered across both stereo image planes. To improve the density of the reconstruction and to reduce the uncertainty of the estimation, a probabilistic depth-fusion strategy is also developed. The resulting method has no special requirements on either the motion of the stereo event-camera rig or on prior knowledge about the scene. Experiments demonstrate our method can deal with both texture-rich scenes as well as sparse scenes, outperforming state-of-the-art stereo methods based on event data image representations.

READ FULL TEXT

page 6

page 13

page 14

research
11/30/2021

ESL: Event-based Structured Light

Event cameras are bio-inspired sensors providing significant advantages ...
research
07/30/2020

Event-based Stereo Visual Odometry

Event-based cameras are bio-inspired vision sensors whose pixels work in...
research
12/09/2020

E3D: Event-Based 3D Shape Reconstruction

3D shape reconstruction is a primary component of augmented/virtual real...
research
04/14/2021

Deep Permutation Equivariant Structure from Motion

Existing deep methods produce highly accurate 3D reconstructions in ster...
research
10/17/2022

Event-based Stereo Depth Estimation from Ego-motion using Ray Density Fusion

Event cameras are bio-inspired sensors that mimic the human retina by re...
research
09/01/2021

EVReflex: Dense Time-to-Impact Prediction for Event-based Obstacle Avoidance

The broad scope of obstacle avoidance has led to many kinds of computer ...
research
09/15/2023

Robust e-NeRF: NeRF from Sparse Noisy Events under Non-Uniform Motion

Event cameras offer many advantages over standard cameras due to their d...

Please sign up or login with your details

Forgot password? Click here to reset