Monocular Depth Estimation with Sharp Boundary

10/12/2021
by   Xin Yang, et al.
10

Monocular depth estimation is the base task in computer vision. It has a tremendous development in the decade with the development of deep learning. But the boundary blur of the depth map is still a serious problem. Research finds the boundary blur problem is mainly caused by two factors, first, the low-level features containing boundary and structure information may loss in deeper networks during the convolution process., second, the model ignores the errors introduced by the boundary area due to the few portions of the boundary in the whole areas during the backpropagation. In order to mitigate the boundary blur problem, we focus on the above two impact factors. Firstly, we design a scene understanding module to learn the global information with low- and high-level features, and then to transform the global information to different scales with our proposed scale transform module according to the different phases in the decoder. Secondly, we propose a boundary-aware depth loss function to pay attention to the effects of the boundary's depth value. The extensive experiments show that our method can predict the depth maps with clearer boundaries, and the performance of the depth accuracy base on NYU-depth v2 and SUN RGB-D is competitive.

READ FULL TEXT

page 2

page 3

page 11

page 13

page 15

research
07/14/2021

MSFNet:Multi-scale features network for monocular depth estimation

In recent years, monocular depth estimation is applied to understand the...
research
02/26/2021

Boundary-induced and scene-aggregated network for monocular depth prediction

Monocular depth prediction is an important task in scene understanding. ...
research
09/10/2019

Structure-Attentioned Memory Network for Monocular Depth Estimation

Monocular depth estimation is a challenging task that aims to predict a ...
research
03/18/2022

Distortion-Tolerant Monocular Depth Estimation On Omnidirectional Images Using Dual-cubemap

Estimating the depth of omnidirectional images is more challenging than ...
research
12/05/2016

Local Blur Mapping: Exploiting High-Level Semantics by Deep Neural Networks

The human visual system excels at detecting local blur of visual images,...
research
08/16/2023

Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNN

Monocular depth estimation is an ongoing challenge in computer vision. R...
research
11/19/2020

Defocus Blur Detection via Salient Region Detection Prior

Defocus blur always occurred in photos when people take photos by Digita...

Please sign up or login with your details

Forgot password? Click here to reset