Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving

05/18/2022
by   Jie Xiang, et al.
0

Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the scale ambiguity issue. In this paper, we introduce a fully Visual Attention-based Depth (VADepth) network, where spatial attention and channel attention are applied to all stages. By continuously extracting the dependencies of features along the spatial and channel dimensions over a long distance, VADepth network can effectively preserve important details and suppress interfering features to better perceive the scene structure for more accurate depth estimates. In addition, we utilize geometric priors to form scale constraints for scale-aware model training. Specifically, we construct a novel scale-aware loss using the distance between the camera and a plane fitted by the ground points corresponding to the pixels of the rectangular area in the bottom middle of the image. Experimental results on the KITTI dataset show that this architecture achieves the state-of-the-art performance and our method can directly output absolute depth without post-processing. Moreover, our experiments on the SeasonDepth dataset also demonstrate the robustness of our model to multiple unseen environments.

READ FULL TEXT

page 1

page 6

page 7

research
12/24/2021

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

Self-supervised learning has shown very promising results for monocular ...
research
10/24/2022

Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

Depth information is the foundation of perception, essential for autonom...
research
08/10/2020

SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Driving

State-of-the-art self-supervised learning approaches for monocular depth...
research
04/21/2023

FSNet: Redesign Self-Supervised MonoDepth for Full-Scale Depth Prediction for Autonomous Driving

Predicting accurate depth with monocular images is important for low-cos...
research
05/06/2019

PackNet-SfM: 3D Packing for Self-Supervised Monocular Depth Estimation

Densely estimating the depth of a scene from a single image is an ill-po...
research
10/08/2022

Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation

Monocular depth estimation (MDE) in the self-supervised scenario has eme...
research
07/13/2019

S&CNet: A Enhanced Coarse-to-fine Framework For Monocular Depth Completion

Real-time depth completing is a critical problem for robotics and autono...

Please sign up or login with your details

Forgot password? Click here to reset