Temporally coherent 4D reconstruction of complex dynamic scenes

03/10/2016
by   Armin Mustafa, et al.
0

This paper presents an approach for reconstruction of 4D temporally coherent models of complex dynamic scenes. No prior knowledge is required of scene structure or camera calibration allowing reconstruction from multiple moving cameras. Sparse-to-dense temporal correspondence is integrated with joint multi-view segmentation and reconstruction to obtain a complete 4D representation of static and dynamic objects. Temporal coherence is exploited to overcome visual ambiguities resulting in improved reconstruction of complex scenes. Robust joint segmentation and reconstruction of dynamic objects is achieved by introducing a geodesic star convexity constraint. Comparative evaluation is performed on a variety of unstructured indoor and outdoor dynamic scenes with hand-held cameras and multiple people. This demonstrates reconstruction of complete temporally coherent 4D scene models with improved nonrigid object segmentation and shape reconstruction.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
07/18/2019

Temporally Coherent General Dynamic Scene Reconstruction

Existing techniques for dynamic scene reconstruction from multiple wide-...
research
07/23/2019

U4D: Unsupervised 4D Dynamic Scene Understanding

We introduce the first approach to solve the challenging problem of unsu...
research
05/26/2014

Robust Temporally Coherent Laplacian Protrusion Segmentation of 3D Articulated Bodies

In motion analysis and understanding it is important to be able to fit a...
research
04/30/2018

4D Temporally Coherent Light-field Video

Light-field video has recently been used in virtual and augmented realit...
research
04/01/2023

Multi-view reconstruction of bullet time effect based on improved NSFF model

Bullet time is a type of visual effect commonly used in film, television...
research
12/19/2020

The importance of silhouette optimization in 3D shape reconstruction system from multiple object scenes

This paper presents a multi stage 3D shape reconstruction system of mult...
research
03/28/2018

Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework

Rain removal is important for improving the robustness of outdoor vision...

Please sign up or login with your details

Forgot password? Click here to reset