Robust 3D reconstruction of dynamic scenes from single-photon lidar using Beta-divergences

04/20/2020
by   Quentin Legros, et al.
0

In this paper, we present a new algorithm for fast, online 3D reconstruction of dynamic scenes using times of arrival of photons recorded by single-photon detector arrays. One of the main challenges in 3D imaging using single-photon lidar in practical applications is the presence of strong ambient illumination which corrupts the data and can jeopardize the detection of peaks/surface in the signals. This background noise not only complicates the observation model classically used for 3D reconstruction but also the estimation procedure which requires iterative methods. In this work, we consider a new similarity measure for robust depth estimation, which allows us to use a simple observation model and a non-iterative estimation procedure while being robust to mis-specification of the background illumination model. This choice leads to a computationally attractive depth estimation procedure without significant degradation of the reconstruction performance. This new depth estimation procedure is coupled with a spatio-temporal model to capture the natural correlation between neighboring pixels and successive frames for dynamic scene analysis. The resulting online inference process is scalable and well suited for parallel implementation. The benefits of the proposed method are demonstrated through a series of experiments conducted with simulated and real single-photon lidar videos, allowing the analysis of dynamic scenes at 325 m observed under extreme ambient illumination conditions.

READ FULL TEXT
research
05/08/2019

Fast online 3D reconstruction of dynamic scenes from individual single-photon detection events

In this paper, we present an algorithm for online 3D reconstruction of d...
research
03/02/2022

Sketched RT3D: How to reconstruct billions of photons per second

Single-photon light detection and ranging (lidar) captures depth and int...
research
03/26/2023

Multi-Frame Self-Supervised Depth Estimation with Multi-Scale Feature Fusion in Dynamic Scenes

Multi-frame methods improve monocular depth estimation over single-frame...
research
03/30/2021

DynOcc: Learning Single-View Depth from Dynamic Occlusion Cues

Recently, significant progress has been made in single-view depth estima...
research
12/12/2019

EM-based approach to 3D reconstruction from single-waveform multispectral Lidar data

In this paper, we present a novel Bayesian approach for estimating spect...
research
03/20/2019

Photon-Flooded Single-Photon 3D Cameras

Single photon avalanche diodes (SPADs) are starting to play a pivotal ro...
research
03/18/2021

Robust and Guided Bayesian Reconstruction of Single-Photon 3D Lidar Data: Application to Multispectral and Underwater Imaging

3D Lidar imaging can be a challenging modality when using multiple wavel...

Please sign up or login with your details

Forgot password? Click here to reset