Digging Into Self-Supervised Monocular Depth Estimation

06/04/2018
by   Clément Godard, et al.
2

Depth-sensing is important for both navigation and scene understanding. However, procuring RGB images with corresponding depth data for training deep models is challenging; large-scale, varied, datasets with ground truth training data are scarce. Consequently, several recent methods have proposed treating the training of monocular color-to-depth estimation networks as an image reconstruction problem, thus forgoing the need for ground truth depth. There are multiple concepts and design decisions for these networks that seem sensible, but give mixed or surprising results when tested. For example, binocular stereo as the source of self-supervision seems cumbersome and hard to scale, yet results are less blurry compared to training with monocular videos. Such decisions also interplay with questions about architectures, loss functions, image scales, and motion handling. In this paper, we propose a simple yet effective model, with several general architectural and loss innovations, that surpasses all other self-supervised depth estimation approaches on KITTI.

READ FULL TEXT

page 2

page 12

page 13

page 14

page 23

page 24

research
03/31/2020

Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volume

Monocular depth estimation has become one of the most studied applicatio...
research
12/19/2020

Self-supervised monocular depth estimation from oblique UAV videos

UAVs have become an essential photogrammetric measurement as they are af...
research
03/14/2023

One scalar is all you need – absolute depth estimation using monocular self-supervision

Self-supervised monocular depth estimators can be trained or fine-tuned ...
research
02/24/2022

N-QGN: Navigation Map from a Monocular Camera using Quadtree Generating Networks

Monocular depth estimation has been a popular area of research for sever...
research
06/25/2018

Self-supervised Learning for Dense Depth Estimation in Monocular Endoscopy

We present a self-supervised approach to training convolutional neural n...
research
09/13/2021

On the Sins of Image Synthesis Loss for Self-supervised Depth Estimation

Scene depth estimation from stereo and monocular imagery is critical for...
research
09/19/2019

Self-Supervised Monocular Depth Hints

Monocular depth estimators can be trained with various forms of self-sup...

Please sign up or login with your details

Forgot password? Click here to reset