DeepAI
Log In Sign Up

Full Surround Monodepth from Multiple Cameras

03/31/2021
by   Vitor Guizilini, et al.
16

Self-supervised monocular depth and ego-motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses on a single monocular camera or stereo pairs that cover only a fraction of the scene around the vehicle. In this work, we extend monocular self-supervised depth and ego-motion estimation to large-baseline multi-camera rigs. Using generalized spatio-temporal contexts, pose consistency constraints, and carefully designed photometric loss masking, we learn a single network generating dense, consistent, and scale-aware point clouds that cover the same full surround 360 degree field of view as a typical LiDAR scanner. We also propose a new scale-consistent evaluation metric more suitable to multi-camera settings. Experiments on two challenging benchmarks illustrate the benefits of our approach over strong baselines.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

page 10

page 11

page 12

04/07/2022

SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation

Depth estimation from images serves as the fundamental step of 3D percep...
03/21/2020

Monocular Depth Prediction Through Continuous 3D Loss

This paper reports a new continuous 3D loss function for learning depth ...
06/27/2022

MGNet: Monocular Geometric Scene Understanding for Autonomous Driving

We introduce MGNet, a multi-task framework for monocular geometric scene...
11/02/2020

Unsupervised Monocular Depth Learning with Integrated Intrinsics and Spatio-Temporal Constraints

Monocular depth inference has gained tremendous attention from researche...
04/07/2020

Depth Sensing Beyond LiDAR Range

Depth sensing is a critical component of autonomous driving technologies...
07/19/2018

LIMO: Lidar-Monocular Visual Odometry

Higher level functionality in autonomous driving depends strongly on a p...