Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation

10/08/2022
by   Peizhe Jiang, et al.
0

Monocular depth estimation (MDE) in the self-supervised scenario has emerged as a promising method as it refrains from the requirement of ground truth depth. Despite continuous efforts, MDE is still sensitive to scale changes especially when all the training samples are from one single camera. Meanwhile, it deteriorates further since camera movement results in heavy coupling between the predicted depth and the scale change. In this paper, we present a scale-invariant approach for self-supervised MDE, in which scale-sensitive features (SSFs) are detached away while scale-invariant features (SIFs) are boosted further. To be specific, a simple but effective data augmentation by imitating the camera zooming process is proposed to detach SSFs, making the model robust to scale changes. Besides, a dynamic cross-attention module is designed to boost SIFs by fusing multi-scale cross-attention features adaptively. Extensive experiments on the KITTI dataset demonstrate that the detaching and boosting strategies are mutually complementary in MDE and our approach achieves new State-of-The-Art performance against existing works from 0.097 to 0.090 w.r.t absolute relative error. The code will be made public soon.

READ FULL TEXT
research
07/25/2022

RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimation

Existing self-supervised monocular depth estimation methods can get rid ...
research
03/01/2021

ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimation

Self-supervised learning of depth has been a highly studied topic of res...
research
04/06/2023

EGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimation

The ubiquitous multi-camera setup on modern autonomous vehicles provides...
research
04/15/2022

Multi-Frame Self-Supervised Depth with Transformers

Multi-frame depth estimation improves over single-frame approaches by al...
research
05/18/2022

Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving

Although existing monocular depth estimation methods have made great pro...
research
05/16/2020

Deep feature fusion for self-supervised monocular depth prediction

Recent advances in end-to-end unsupervised learning has significantly im...
research
03/14/2023

One scalar is all you need – absolute depth estimation using monocular self-supervision

Self-supervised monocular depth estimators can be trained or fine-tuned ...

Please sign up or login with your details

Forgot password? Click here to reset