3DFS: Deformable Dense Depth Fusion and Segmentation for Object Reconstruction from a Handheld Camera

06/15/2016
by   Tanmay Gupta, et al.
0

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that preserves detail. The resulting depth maps are then fused using a proposed implicit surface function that is robust to estimation error, producing a smooth surface reconstruction of the entire scene. Finally, the object is segmented from the remaining scene using a proposed 2D-3D segmentation that incorporates image and depth cues with priors and regularization over the 3D volume and 2D segmentations. We evaluate 3D reconstructions qualitatively on our Object-Videos dataset, comparing to fusion, multiview stereo, and segmentation baselines. We also quantitatively evaluate the dense depth estimation using the RGBD Scenes V2 dataset [Henry et al. 2013] and the segmentation using keyframe annotations of the Object-Videos dataset.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

page 9

page 11

research
03/19/2021

Probabilistic Multi-View Fusion of Active Stereo Depth Maps for Robotic Bin-Picking

The reliable fusion of depth maps from multiple viewpoints has become an...
research
10/05/2020

Depth-wise layering of 3d images using dense depth maps: a threshold based approach

Image segmentation has long been a basic problem in computer vision. Dep...
research
05/22/2017

DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels

In the context of scene understanding, a variety of methods exists to es...
research
04/03/2022

BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusion

Dense 3D reconstruction from a stream of depth images is the key to many...
research
08/19/2021

VolumeFusion: Deep Depth Fusion for 3D Scene Reconstruction

To reconstruct a 3D scene from a set of calibrated views, traditional mu...
research
04/01/2019

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Three-dimensional (3D) reconstruction and scene depth estimation from 2-...
research
02/10/2021

Polarimetric Monocular Dense Mapping Using Relative Deep Depth Prior

This paper is concerned with polarimetric dense map reconstruction based...

Please sign up or login with your details

Forgot password? Click here to reset