Towards General Purpose and Geometry Preserving Single-View Depth Estimation

09/25/2020
by   Mikhail Romanov, et al.
0

Single-view depth estimation plays a crucial role in scene understanding for AR applications and 3D modelling as it allows to retrieve the geometry of a scene. However, it is only possible if the inverse depth estimates are unbiased, i.e. they are either absolute or Up-to-Scale (UTS). In recent years, great progress has been made in general-purpose single-view depth estimation. Nevertheless, the latest general-purpose models were trained using ranking or on Up-to-Shift-Scale (UTSS) data. As a result, they provide UTSS predictions that cannot be used to reconstruct scene geometry. In this work, we strive to build a general-purpose single-view UTS depth estimation model. Following Ranftl et. al., we train our model on a mixture of datasets and test it on several previously unseen datasets. We show that our method outperforms previous state-of-the-art UTS models. We train several light-weight models following the proposed training scheme and prove that our ideas are applicable for computationally efficient depth estimation.

READ FULL TEXT

page 8

page 11

research
06/05/2023

Single-Stage 3D Geometry-Preserving Depth Estimation Model Training on Dataset Mixtures with Uncalibrated Stereo Data

Nowadays, robotics, AR, and 3D modeling applications attract considerabl...
research
09/18/2023

Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering

In this study, we address the challenge of 3D scene structure recovery f...
research
03/04/2017

Sparse Depth Sensing for Resource-Constrained Robots

We consider the case in which a robot has to navigate in an unknown envi...
research
05/17/2018

Recurrent Neural Network for Learning DenseDepth and Ego-Motion from Video

Learning-based, single-view depth estimation often generalizes poorly to...
research
07/27/2023

FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene

It has long been an ill-posed problem to predict absolute depth maps fro...
research
12/21/2022

Lightweight Monocular Depth Estimation

Monocular depth estimation can play an important role in addressing the ...
research
01/05/2023

All in Tokens: Unifying Output Space of Visual Tasks via Soft Token

Unlike language tasks, where the output space is usually limited to a se...

Please sign up or login with your details

Forgot password? Click here to reset