Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes

08/18/2021
by   Keyang Zhou, et al.
6

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for depth estimation are limited due to large noise, low accuracy, and strict requirements for multi-camera calibration. In this work, for a unified surrounding perception, we introduce panoramic images to obtain larger field of view. We extend PADENet first appeared in our previous conference work for outdoor scene understanding, to perform panoramic monocular depth estimation with a focus for indoor scenes. At the same time, we improve the training process of the neural network adapted to the characteristics of panoramic images. In addition, we fuse traditional stereo matching algorithm with deep learning methods and further improve the accuracy of depth predictions. With a comprehensive variety of experiments, this research demonstrates the effectiveness of our schemes aiming for indoor scene perception.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 9

research
04/14/2020

RealMonoDepth: Self-Supervised Monocular Depth Estimation for General Scenes

We present a generalised self-supervised learning approach for monocular...
research
09/08/2019

Robust Full-FoV Depth Estimation in Tele-wide Camera System

Tele-wide camera system with different Field of View (FoV) lenses become...
research
01/22/2020

Active Perception with A Monocular Camera for Multiscopic Vision

We design a multiscopic vision system that utilizes a low-cost monocular...
research
10/20/2021

Event Guided Depth Sensing

Active depth sensors like structured light, lidar, and time-of-flight sy...
research
12/24/2019

DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling

We describe a technique that automatically generates plausible depth map...
research
07/15/2020

P^2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimation

This paper tackles the unsupervised depth estimation task in indoor envi...
research
10/15/2018

Playing for Depth

Estimating the relative depth of a scene is a significant step towards u...

Please sign up or login with your details

Forgot password? Click here to reset