Neural Contourlet Network for Monocular 360 Depth Estimation

08/03/2022
by   Zhijie Shen, et al.
13

For a monocular 360 image, depth estimation is a challenging because the distortion increases along the latitude. To perceive the distortion, existing methods devote to designing a deep and complex network architecture. In this paper, we provide a new perspective that constructs an interpretable and sparse representation for a 360 image. Considering the importance of the geometric structure in depth estimation, we utilize the contourlet transform to capture an explicit geometric cue in the spectral domain and integrate it with an implicit cue in the spatial domain. Specifically, we propose a neural contourlet network consisting of a convolutional neural network and a contourlet transform branch. In the encoder stage, we design a spatial-spectral fusion module to effectively fuse two types of cues. Contrary to the encoder, we employ the inverse contourlet transform with learned low-pass subbands and band-pass directional subbands to compose the depth in the decoder. Experiments on the three popular panoramic image datasets demonstrate that the proposed approach outperforms the state-of-the-art schemes with faster convergence. Code is available at https://github.com/zhijieshen-bjtu/Neural-Contourlet-Network-for-MODE.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 8

page 10

research
01/14/2023

S^2Net: Accurate Panorama Depth Estimation on Spherical Surface

Monocular depth estimation is an ambiguous problem, thus global structur...
research
04/03/2022

BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation

Monocular depth estimation is a fundamental task in computer vision and ...
research
08/19/2021

Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimation

Self-supervised monocular depth estimation has been widely studied, owin...
research
08/11/2021

Towards Interpretable Deep Networks for Monocular Depth Estimation

Deep networks for Monocular Depth Estimation (MDE) have achieved promisi...
research
05/24/2021

Pan-sharpening via High-pass Modification Convolutional Neural Network

Most existing deep learning-based pan-sharpening methods have several wi...
research
04/20/2023

A geometry-aware deep network for depth estimation in monocular endoscopy

Monocular depth estimation is critical for endoscopists to perform spati...
research
06/03/2021

Single Image Depth Estimation using Wavelet Decomposition

We present a novel method for predicting accurate depths from monocular ...

Please sign up or login with your details

Forgot password? Click here to reset