Self-Supervised Monocular Depth Estimation of Untextured Indoor Rotated Scenes

06/24/2021
by   Benjamin Keltjens, et al.
4

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on indoor environments with camera rotation. Indoor, rotated scenes are common for less constrained applications and pose problems for two reasons: abundance of low texture regions and increased complexity of depth cues for images under rotation. In an effort to extend self-supervised learning to more generalised environments we propose two additions. First, we propose a novel Filled Disparity Loss term that corrects for ambiguity of image reconstruction error loss in textureless regions. Specifically, we interpolate disparity in untextured regions, using the estimated disparity from surrounding textured areas, and use L1 loss to correct the original estimation. Our experiments show that depth estimation is substantially improved on low-texture scenes, without any loss on textured scenes, when compared to Monodepth by Godard et al. Secondly, we show that training with an application's representative rotations, in both pitch and roll, is sufficient to significantly improve performance over the entire range of expected rotation. We demonstrate that depth estimation is successfully generalised as performance is not lost when evaluated on test sets with no camera rotation. Together these developments enable a broader use of self-supervised learning of monocular depth estimation for complex environments.

READ FULL TEXT

page 3

page 4

page 7

page 10

page 11

page 12

page 13

research
04/14/2020

RealMonoDepth: Self-Supervised Monocular Depth Estimation for General Scenes

We present a generalised self-supervised learning approach for monocular...
research
05/20/2022

Self-Supervised Depth Estimation with Isometric-Self-Sample-Based Learning

Managing the dynamic regions in the photometric loss formulation has bee...
research
10/11/2022

Frequency-Aware Self-Supervised Monocular Depth Estimation

We present two versatile methods to generally enhance self-supervised mo...
research
04/03/2022

Distortion-Aware Self-Supervised 360° Depth Estimation from A Single Equirectangular Projection Image

360 images are widely available over the last few years. This paper prop...
research
07/26/2021

MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments

Self-supervised depth estimation for indoor environments is more challen...
research
10/29/2019

On the Benefit of Adversarial Training for Monocular Depth Estimation

In this paper we address the benefit of adding adversarial training to t...
research
07/15/2020

P^2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimation

This paper tackles the unsupervised depth estimation task in indoor envi...

Please sign up or login with your details

Forgot password? Click here to reset