360^∘ Depth Estimation from Multiple Fisheye Images with Origami Crown Representation of Icosahedron

07/14/2020
by   Ren Komatsu, et al.
0

In this study, we present a method for all-around depth estimation from multiple omnidirectional images for indoor environments. In particular, we focus on plane-sweeping stereo as the method for depth estimation from the images. We propose a new icosahedron-based representation and ConvNets for omnidirectional images, which we name "CrownConv" because the representation resembles a crown made of origami. CrownConv can be applied to both fisheye images and equirectangular images to extract features. Furthermore, we propose icosahedron-based spherical sweeping for generating the cost volume on an icosahedron from the extracted features. The cost volume is regularized using the three-dimensional CrownConv, and the final depth is obtained by depth regression from the cost volume. Our proposed method is robust to camera alignments by using the extrinsic camera parameters; therefore, it can achieve precise depth estimation even when the camera alignment differs from that in the training dataset. We evaluate the proposed model on synthetic datasets and demonstrate its effectiveness. As our proposed method is computationally efficient, the depth is estimated from four fisheye images in less than a second using a laptop with a GPU. Therefore, it is suitable for real-world robotics applications. Our source code is available at https://github.com/matsuren/crownconv360depth.

READ FULL TEXT

page 1

page 3

page 4

page 8

research
12/30/2021

Dense Depth Estimation from Multiple 360-degree Images Using Virtual Depth

In this paper, we propose a dense depth estimation pipeline for multivie...
research
11/11/2019

360SD-Net: 360° Stereo Depth Estimation with Learnable Cost Volume

Recently, end-to-end trainable deep neural networks have significantly i...
research
03/17/2022

PanoFormer: Panorama Transformer for Indoor 360° Depth Estimation

Existing panoramic depth estimation methods based on convolutional neura...
research
07/20/2022

Learning Depth from Focus in the Wild

For better photography, most recent commercial cameras including smartph...
research
03/09/2022

Monocular Depth Distribution Alignment with Low Computation

The performance of monocular depth estimation generally depends on the a...
research
03/23/2023

Collaboration Helps Camera Overtake LiDAR in 3D Detection

Camera-only 3D detection provides an economical solution with a simple c...
research
12/03/2021

Deep Depth from Focus with Differential Focus Volume

Depth-from-focus (DFF) is a technique that infers depth using the focus ...

Please sign up or login with your details

Forgot password? Click here to reset