DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling

12/24/2019
by   Kevin Karsch, et al.
0

We describe a technique that automatically generates plausible depth maps from videos using non-parametric depth sampling. We demonstrate our technique in cases where past methods fail (non-translating cameras and dynamic scenes). Our technique is applicable to single images as well as videos. For videos, we use local motion cues to improve the inferred depth maps, while optical flow is used to ensure temporal depth consistency. For training and evaluation, we use a Kinect-based system to collect a large dataset containing stereoscopic videos with known depths. We show that our depth estimation technique outperforms the state-of-the-art on benchmark databases. Our technique can be used to automatically convert a monoscopic video into stereo for 3D visualization, and we demonstrate this through a variety of visually pleasing results for indoor and outdoor scenes, including results from the feature film Charade.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

08/12/2021

DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenes

We present a novel approach for estimating depth from a monocular camera...
03/30/2021

DynOcc: Learning Single-View Depth from Dynamic Occlusion Cues

Recently, significant progress has been made in single-view depth estima...
12/30/2019

Video Depth Estimation by Fusing Flow-to-Depth Proposals

We present an approach with a novel differentiable flow-to-depth layer f...
04/25/2019

Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes

We present a fully data-driven method to compute depth from diverse mono...
09/03/2016

Towards Segmenting Consumer Stereo Videos: Benchmark, Baselines and Ensembles

Are we ready to segment consumer stereo videos? The amount of this data ...
04/14/2013

Single View Depth Estimation from Examples

We describe a non-parametric, "example-based" method for estimating the ...
01/18/2021

Deadeye: A Novel Preattentive Visualization Technique Based on Dichoptic Presentation

Preattentive visual features such as hue or flickering can effectively d...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.