Calibrating Self-supervised Monocular Depth Estimation

09/16/2020
by   Robert McCraith, et al.
0

In the recent years, many methods demonstrated the ability of neural networks tolearn depth and pose changes in a sequence of images, using only self-supervision as thetraining signal. Whilst the networks achieve good performance, the often over-lookeddetail is that due to the inherent ambiguity of monocular vision they predict depth up to aunknown scaling factor. The scaling factor is then typically obtained from the LiDARground truth at test time, which severely limits practical applications of these methods.In this paper, we show that incorporating prior information about the camera configu-ration and the environment, we can remove the scale ambiguity and predict depth directly,still using the self-supervised formulation and not relying on any additional sensors.

READ FULL TEXT

page 4

page 6

page 7

research
03/10/2022

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

Monocular depth estimation in the wild inherently predicts depth up to a...
research
09/08/2021

LiDARTouch: Monocular metric depth estimation with a few-beam LiDAR

Vision-based depth estimation is a key feature in autonomous systems, wh...
research
03/22/2021

Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervision

Depth information is essential for on-board perception in autonomous dri...
research
09/08/2020

Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation

The self-supervised loss formulation for jointly training depth and egom...
research
10/06/2022

Self-Supervised Monocular Depth Underwater

Depth estimation is critical for any robotic system. In the past years e...
research
03/14/2023

One scalar is all you need – absolute depth estimation using monocular self-supervision

Self-supervised monocular depth estimators can be trained or fine-tuned ...
research
11/16/2022

Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery

Self-supervised learning of egomotion and depth has recently attracted g...

Please sign up or login with your details

Forgot password? Click here to reset