CamLessMonoDepth: Monocular Depth Estimation with Unknown Camera Parameters

10/27/2021
by   Sai Shyam Chanduri, et al.
8

Perceiving 3D information is of paramount importance in many applications of computer vision. Recent advances in monocular depth estimation have shown that gaining such knowledge from a single camera input is possible by training deep neural networks to predict inverse depth and pose, without the necessity of ground truth data. The majority of such approaches, however, require camera parameters to be fed explicitly during training. As a result, image sequences from wild cannot be used during training. While there exist methods which also predict camera intrinsics, their performance is not on par with novel methods taking camera parameters as input. In this work, we propose a method for implicit estimation of pinhole camera intrinsics along with depth and pose, by learning from monocular image sequences alone. In addition, by utilizing efficient sub-pixel convolutions, we show that high fidelity depth estimates can be obtained. We also embed pixel-wise uncertainty estimation into the framework, to emphasize the possible applicability of this work in practical domain. Finally, we demonstrate the possibility of accurate prediction of depth information without prior knowledge of camera intrinsics, while outperforming the existing state-of-the-art approaches on KITTI benchmark.

READ FULL TEXT

page 4

page 7

page 9

page 10

page 17

page 19

page 20

page 22

research
04/14/2023

Self-Supervised Learning based Depth Estimation from Monocular Images

Depth Estimation has wide reaching applications in the field of Computer...
research
03/21/2018

Monocular Depth Estimation by Learning from Heterogeneous Datasets

Depth estimation provides essential information to perform autonomous dr...
research
05/16/2019

How do neural networks see depth in single images?

Deep neural networks have lead to a breakthrough in depth estimation fro...
research
08/23/2021

Vogtareuth Rehab Depth Datasets: Benchmark for Marker-less Posture Estimation in Rehabilitation

Posture estimation using a single depth camera has become a useful tool ...
research
07/08/2020

When Perspective Comes for Free: Improving Depth Prediction with Camera Pose Encoding

Monocular depth prediction is a highly underdetermined problem and recen...
research
12/21/2020

Monocular Depth Parameterizing Networks

Monocular depth estimation is a highly challenging problem that is often...
research
12/01/2017

Learning Depth from Monocular Videos using Direct Methods

The ability to predict depth from a single image - using recent advances...

Please sign up or login with your details

Forgot password? Click here to reset