Monocular Depth Prediction Through Continuous 3D Loss

03/21/2020
by   Minghan Zhu, et al.
23

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, exploiting available data from camera-LIDAR sensor suites during training. Currently, accurate and affordable range sensor is not available. Stereo cameras and LIDARs measure depth either inaccurately or sparsely/costly. In contrast to the current point-to-point loss evaluation approach, the proposed 3D loss treats point clouds as continuous objects; and therefore, it overcomes the lack of dense ground truth depth due to the sparsity of LIDAR measurements. Experimental evaluations show that the proposed method achieves accurate depth measurement with consistent 3D geometric structures through a monocular camera.

READ FULL TEXT

page 1

page 4

page 5

page 7

research
02/09/2017

Semi-Supervised Deep Learning for Monocular Depth Map Prediction

Supervised deep learning often suffers from the lack of sufficient train...
research
09/24/2018

Improved Semantic Stixels via Multimodal Sensor Fusion

This paper presents a compact and accurate representation of 3D scenes t...
research
03/31/2021

Full Surround Monodepth from Multiple Cameras

Self-supervised monocular depth and ego-motion estimation is a promising...
research
09/20/2022

Self-supervised 3D Object Detection from Monocular Pseudo-LiDAR

There have been attempts to detect 3D objects by fusion of stereo camera...
research
10/07/2019

Improvements to Target-Based 3D LiDAR to Camera Calibration

The homogeneous transformation between a LiDAR and monocular camera is r...
research
08/04/2020

MSDPN: Monocular Depth Prediction with Partial Laser Observation using Multi-stage Neural Networks

In this study, a deep-learning-based multi-stage network architecture ca...
research
06/03/2020

PLG-IN: Pluggable Geometric Consistency Loss with Wasserstein Distance in Monocular Depth Estimation

We propose a novel objective to penalize geometric inconsistencies, to i...

Please sign up or login with your details

Forgot password? Click here to reset