Adaptive Illumination based Depth Sensing using Deep Learning

03/23/2021
by   Qiqin Dai, et al.
0

Dense depth map capture is challenging in existing active sparse illumination based depth acquisition techniques, such as LiDAR. Various techniques have been proposed to estimate a dense depth map based on fusion of the sparse depth map measurement with the RGB image. Recent advances in hardware enable adaptive depth measurements resulting in further improvement of the dense depth map estimation. In this paper, we study the topic of estimating dense depth from depth sampling. The adaptive sparse depth sampling network is jointly trained with a fusion network of an RGB image and sparse depth, to generate optimal adaptive sampling masks. We show that such adaptive sampling masks can generalize well to many RGB and sparse depth fusion algorithms under a variety of sampling rates (as low as 0.0625%). The proposed adaptive sampling method is fully differentiable and flexible to be trained end-to-end with upstream perception algorithms.

READ FULL TEXT

page 2

page 3

page 7

page 8

research
03/21/2022

RGB-Depth Fusion GAN for Indoor Depth Completion

The raw depth image captured by the indoor depth sensor usually has an e...
research
10/27/2020

A Method of Generating Measurable Panoramic Image for Indoor Mobile Measurement System

This paper designs a technique route to generate high-quality panoramic ...
research
05/20/2022

How to Guide Adaptive Depth Sampling?

Recent advances in depth sensing technologies allow fast electronic mane...
research
08/04/2019

Image-Guided Depth Sampling and Reconstruction

Depth acquisition, based on active illumination, is essential for autono...
research
03/21/2020

A MEMS-based Foveating LIDAR to enable Real-time Adaptive Depth Sensing

Most active depth sensors sample their visual field using a fixed patter...
research
05/25/2022

A Low Memory Footprint Quantized Neural Network for Depth Completion of Very Sparse Time-of-Flight Depth Maps

Sparse active illumination enables precise time-of-flight depth sensing ...
research
11/30/2021

Adaptive Gating for Single-Photon 3D Imaging

Single-photon avalanche diodes (SPADs) are growing in popularity for dep...

Please sign up or login with your details

Forgot password? Click here to reset