DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling

by   Kevin Karsch, et al.

We describe a technique that automatically generates plausible depth maps from videos using non-parametric depth sampling. We demonstrate our technique in cases where past methods fail (non-translating cameras and dynamic scenes). Our technique is applicable to single images as well as videos. For videos, we use local motion cues to improve the inferred depth maps, while optical flow is used to ensure temporal depth consistency. For training and evaluation, we use a Kinect-based system to collect a large dataset containing stereoscopic videos with known depths. We show that our depth estimation technique outperforms the state-of-the-art on benchmark databases. Our technique can be used to automatically convert a monoscopic video into stereo for 3D visualization, and we demonstrate this through a variety of visually pleasing results for indoor and outdoor scenes, including results from the feature film Charade.



There are no comments yet.



DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenes

We present a novel approach for estimating depth from a monocular camera...

DynOcc: Learning Single-View Depth from Dynamic Occlusion Cues

Recently, significant progress has been made in single-view depth estima...

Video Depth Estimation by Fusing Flow-to-Depth Proposals

We present an approach with a novel differentiable flow-to-depth layer f...

Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes

We present a fully data-driven method to compute depth from diverse mono...

Towards Segmenting Consumer Stereo Videos: Benchmark, Baselines and Ensembles

Are we ready to segment consumer stereo videos? The amount of this data ...

Single View Depth Estimation from Examples

We describe a non-parametric, "example-based" method for estimating the ...

Deadeye: A Novel Preattentive Visualization Technique Based on Dichoptic Presentation

Preattentive visual features such as hue or flickering can effectively d...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.