Distortion-Tolerant Monocular Depth Estimation On Omnidirectional Images Using Dual-cubemap

03/18/2022
by   Zhijie Shen, et al.
0

Estimating the depth of omnidirectional images is more challenging than that of normal field-of-view (NFoV) images because the varying distortion can significantly twist an object's shape. The existing methods suffer from troublesome distortion while estimating the depth of omnidirectional images, leading to inferior performance. To reduce the negative impact of the distortion influence, we propose a distortion-tolerant omnidirectional depth estimation algorithm using a dual-cubemap. It comprises two modules: Dual-Cubemap Depth Estimation (DCDE) module and Boundary Revision (BR) module. In DCDE module, we present a rotation-based dual-cubemap model to estimate the accurate NFoV depth, reducing the distortion at the cost of boundary discontinuity on omnidirectional depths. Then a boundary revision module is designed to smooth the discontinuous boundaries, which contributes to the precise and visually continuous omnidirectional depths. Extensive experiments demonstrate the superiority of our method over other state-of-the-art solutions.

READ FULL TEXT

page 2

page 3

page 5

research
10/18/2020

Distortion-aware Monocular Depth Estimation for Omnidirectional Images

A main challenge for tasks on panorama lies in the distortion of objects...
research
01/14/2023

S^2Net: Accurate Panorama Depth Estimation on Spherical Surface

Monocular depth estimation is an ambiguous problem, thus global structur...
research
10/12/2021

Monocular Depth Estimation with Sharp Boundary

Monocular depth estimation is the base task in computer vision. It has a...
research
07/13/2020

UnRectDepthNet: Self-Supervised Monocular Depth Estimation using a Generic Framework for Handling Common Camera Distortion Models

In classical computer vision, rectification is an integral part of multi...
research
07/28/2021

Aug3D-RPN: Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth

Current geometry-based monocular 3D object detection models can efficien...
research
03/17/2022

PanoFormer: Panorama Transformer for Indoor 360° Depth Estimation

Existing panoramic depth estimation methods based on convolutional neura...
research
11/19/2012

Rate-Distortion Analysis of Multiview Coding in a DIBR Framework

Depth image based rendering techniques for multiview applications have b...

Please sign up or login with your details

Forgot password? Click here to reset