Pyramid Frequency Network with Spatial Attention Residual Refinement Module for Monocular Depth Estimation

04/05/2022
by   Zhengyang Lu, et al.
17

Deep-learning-based approaches to depth estimation are rapidly advancing, offering superior performance over existing methods. To estimate the depth in real-world scenarios, depth estimation models require the robustness of various noise environments. In this work, a Pyramid Frequency Network(PFN) with Spatial Attention Residual Refinement Module(SARRM) is proposed to deal with the weak robustness of existing deep-learning methods. To reconstruct depth maps with accurate details, the SARRM constructs a residual fusion method with an attention mechanism to refine the blur depth. The frequency division strategy is designed, and the frequency pyramid network is developed to extract features from multiple frequency bands. With the frequency strategy, PFN achieves better visual accuracy than state-of-the-art methods in both indoor and outdoor scenes on Make3D, KITTI depth, and NYUv2 datasets. Additional experiments on the noisy NYUv2 dataset demonstrate that PFN is more reliable than existing deep-learning methods in high-noise scenes.

READ FULL TEXT

page 7

page 9

page 11

page 21

page 22

page 23

page 24

research
07/13/2019

Structure-Aware Residual Pyramid Network for Monocular Depth Estimation

Monocular depth estimation is an essential task for scene understanding....
research
07/26/2021

MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments

Self-supervised depth estimation for indoor environments is more challen...
research
03/15/2019

DFineNet: Ego-Motion Estimation and Depth Refinement from Sparse, Noisy Depth Input with RGB Guidance

Depth estimation is an important capability for autonomous vehicles to u...
research
03/22/2022

DepthGAN: GAN-based Depth Generation of Indoor Scenes from Semantic Layouts

Limited by the computational efficiency and accuracy, generating complex...
research
07/10/2021

A Weakly-Supervised Depth Estimation Network Using Attention Mechanism

Monocular depth estimation (MDE) is a fundamental task in many applicati...
research
03/23/2018

Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps with Accurate Object Boundaries

We revisit the problem of estimating depth of a scene from its single RG...
research
04/11/2023

Evaluation of short range depth sonifications for visual-to-auditory sensory substitution

Visual to auditory sensory substitution devices convert visual informati...

Please sign up or login with your details

Forgot password? Click here to reset