HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder

05/30/2023
by   Fei Wang, et al.
0

Decoders play significant roles in recovering scene depths. However, the decoders used in previous works ignore the propagation of multilevel lossless fine-grained information, cannot adaptively capture local and global information in parallel, and cannot perform sufficient global statistical analyses on the final output disparities. In addition, the process of mapping from a low-resolution feature space to a high-resolution feature space is a one-to-many problem that may have multiple solutions. Therefore, the quality of the recovered depth map is low. To this end, we propose a high-quality decoder (HQDec), with which multilevel near-lossless fine-grained information, obtained by the proposed adaptive axial-normalized position-embedded channel attention sampling module (AdaAxialNPCAS), can be adaptively incorporated into a low-resolution feature map with high-level semantics utilizing the proposed adaptive information exchange scheme. In the HQDec, we leverage the proposed adaptive refinement module (AdaRM) to model the local and global dependencies between pixels in parallel and utilize the proposed disparity attention module to model the distribution characteristics of disparity values from a global perspective. To recover fine-grained high-resolution features with maximal accuracy, we adaptively fuse the high-frequency information obtained by constraining the upsampled solution space utilizing the local and global dependencies between pixels into the high-resolution feature map generated from the nonlearning method. Extensive experiments demonstrate that each proposed component improves the quality of the depth estimation results over the baseline results, and the developed approach achieves state-of-the-art results on the KITTI and DDAD datasets. The code and models will be publicly available at \href{https://github.com/fwucas/HQDec}{HQDec}.

READ FULL TEXT

page 1

page 4

page 10

page 12

page 13

page 14

research
10/20/2019

Unsupervised High-Resolution Depth Learning From Videos With Dual Networks

Unsupervised depth learning takes the appearance difference between a ta...
research
12/03/2022

Multi-resolution Monocular Depth Map Fusion by Self-supervised Gradient-based Composition

Monocular depth estimation is a challenging problem on which deep neural...
research
10/03/2018

SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimation

Recent techniques in self-supervised monocular depth estimation are appr...
research
12/24/2021

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

Self-supervised learning has shown very promising results for monocular ...
research
03/08/2022

Lightweight Monocular Depth Estimation through Guided Decoding

We present a lightweight encoder-decoder architecture for monocular dept...
research
12/10/2020

Full Matching on Low Resolution for Disparity Estimation

A Multistage Full Matching disparity estimation scheme (MFM) is proposed...
research
04/28/2023

Local-Global Transformer Enhanced Unfolding Network for Pan-sharpening

Pan-sharpening aims to increase the spatial resolution of the low-resolu...

Please sign up or login with your details

Forgot password? Click here to reset