Image-Guided Depth Sampling and Reconstruction

08/04/2019
by   Adam Wolff, et al.
7

Depth acquisition, based on active illumination, is essential for autonomous and robotic navigation. LiDARs (Light Detection And Ranging) with mechanical, fixed, sampling templates are commonly used in today's autonomous vehicles. An emerging technology, based on solid-state depth sensors, with no mechanical parts, allows fast, adaptive, programmable scans. In this paper, we investigate the topic of adaptive, image-driven, sampling and reconstruction strategies. First, we formulate a piece-wise linear depth model with several tolerance parameters and estimate its validity for indoor and outdoor scenes. Our model and experiments predict that, in the optimal case, about 20-60 piece-wise linear structures can approximate well a depth map. This translates to a depth-to-image sampling ratio of about 1/1200. We propose a simple, generic, sampling and reconstruction algorithm, based on super-pixels. We reach a sampling rate which is still far from the optimal case. However, our sampling improves grid and random sampling, consistently, for a wide variety of reconstruction methods. Moreover, our proposed reconstruction achieves state-of-the-art results, compared to image-guided depth completion algorithms, reducing the required sampling rate by a factor of 3-4. A single-pixel depth camera built in our lab illustrates the concept.

READ FULL TEXT

page 2

page 4

page 6

page 10

page 12

page 13

page 15

page 16

research
03/23/2021

Adaptive Illumination based Depth Sensing using Deep Learning

Dense depth map capture is challenging in existing active sparse illumin...
research
07/27/2020

Adaptive LiDAR Sampling and Depth Completion using Ensemble Variance

This work considers the problem of depth completion, with or without ima...
research
05/20/2022

How to Guide Adaptive Depth Sampling?

Recent advances in depth sensing technologies allow fast electronic mane...
research
12/03/2019

Joint Graph-based Depth Refinement and Normal Estimation

Depth estimation is an essential component in understanding the 3D geome...
research
10/13/2020

On Deep Learning Techniques to Boost Monocular Depth Estimation for Autonomous Navigation

Inferring the depth of images is a fundamental inverse problem within th...
research
11/30/2021

Adaptive Gating for Single-Photon 3D Imaging

Single-photon avalanche diodes (SPADs) are growing in popularity for dep...

Please sign up or login with your details

Forgot password? Click here to reset