A Surface Geometry Model for LiDAR Depth Completion

04/17/2021
by   Yiming Zhao, et al.
7

LiDAR depth completion is a task that predicts depth values for every pixel on the corresponding camera frame, although only sparse LiDAR points are available. Most of the existing state-of-the-art solutions are based on deep neural networks, which need a large amount of data and heavy computations for training the models. In this letter, a novel non-learning depth completion method is proposed by exploiting the local surface geometry that is enhanced by an outlier removal algorithm. The proposed surface geometry model is inspired by the observation that most pixels with unknown depth have a nearby LiDAR point. Therefore, it is assumed those pixels share the same surface with the nearest LiDAR point, and their respective depth can be estimated as the nearest LiDAR depth value plus a residual error. The residual error is calculated by using a derived equation with several physical parameters as input, including the known camera intrinsic parameters, estimated normal vector, and offset distance on the image plane. The proposed method is further enhanced by an outlier removal algorithm that is designed to remove incorrectly mapped LiDAR points from occluded regions. On KITTI dataset, the proposed solution achieves the best error performance among all existing non-learning methods and is comparable to the best self-supervised learning method and some supervised learning methods. Moreover, since outlier points from occluded regions is a commonly existing problem, the proposed outlier removal algorithm is a general preprocessing step that is applicable to many robotic systems with both camera and LiDAR sensors.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
10/26/2022

CU-Net: LiDAR Depth-Only Completion With Coupled U-Net

LiDAR depth-only completion is a challenging task to estimate dense dept...
research
10/15/2019

Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints

Depth completion aims to recover dense depth maps from sparse depth meas...
research
06/14/2021

Deterministic Guided LiDAR Depth Map Completion

Accurate dense depth estimation is crucial for autonomous vehicles to an...
research
07/14/2021

PDC: Piecewise Depth Completion utilizing Superpixels

Depth completion from sparse LiDAR and high-resolution RGB data is one o...
research
04/14/2023

Prior based Sampling for Adaptive LiDAR

We propose SampleDepth, a Convolutional Neural Network (CNN), that is su...
research
07/13/2022

Joint Prediction of Monocular Depth and Structure using Planar and Parallax Geometry

Supervised learning depth estimation methods can achieve good performanc...
research
04/06/2021

Depth Completion with Twin Surface Extrapolation at Occlusion Boundaries

Depth completion starts from a sparse set of known depth values and esti...

Please sign up or login with your details

Forgot password? Click here to reset