Playing for Depth

Estimating the relative depth of a scene is a significant step towards understanding the general structure of the depicted scenery, the relations of entities in the scene and their interactions. When faced with the task of estimating depth without the use of Stereo images, we are dependent on the availability of large-scale depth datasets and high-capacity models to capture the intrinsic nature of depth. Unfortunately, creating datasets of depth images is not a trivial task as the requirements for the camera mainly limits us to areas where we can provide the necessities for the camera to work. In this work, we present a new depth dataset captured from Video Games in an easy and reproducible way. The nature of open-world video games gives us the ability to capture high-quality depth maps in the wild without the constrictions of Stereo cameras. Experiments on this dataset shows that using such synthetic datasets increases the accuracy of Monocular Depth Estimation in the wild where other approaches usually fail to generalize.

READ FULL TEXT

page 1

page 3

page 4

page 8

page 9

page 11

page 12

page 13

research
04/11/2019

Learning Single Camera Depth Estimation using Dual-Pixels

Deep learning techniques have enabled rapid progress in monocular depth ...
research
05/04/2023

Edge-aware Consistent Stereo Video Depth Estimation

Video depth estimation is crucial in various applications, such as scene...
research
10/05/2022

Multi-Camera Collaborative Depth Prediction via Consistent Structure Estimation

Depth map estimation from images is an important task in robotic systems...
research
08/18/2021

Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes

Depth estimation, as a necessary clue to convert 2D images into the 3D s...
research
11/19/2022

A Practical Stereo Depth System for Smart Glasses

We present the design of a productionized end-to-end stereo depth sensin...
research
03/26/2020

Holopix50k: A Large-Scale In-the-wild Stereo Image Dataset

With the mass-market adoption of dual-camera mobile phones, leveraging s...
research
03/15/2022

From 2D to 3D: Re-thinking Benchmarking of Monocular Depth Prediction

There have been numerous recently proposed methods for monocular depth p...

Please sign up or login with your details

Forgot password? Click here to reset