Dense image registration and deformable surface reconstruction in presence of occlusions and minimal texture

03/11/2015
by   Dat Tien Ngo, et al.
0

Deformable surface tracking from monocular images is well-known to be under-constrained. Occlusions often make the task even more challenging, and can result in failure if the surface is not sufficiently textured. In this work, we explicitly address the problem of 3D reconstruction of poorly textured, occluded surfaces, proposing a framework based on a template-matching approach that scales dense robust features by a relevancy score. Our approach is extensively compared to current methods employing both local feature matching and dense template alignment. We test on standard datasets as well as on a new dataset (that will be made publicly available) of a sparsely textured, occluded surface. Our framework achieves state-of-the-art results for both well and poorly textured, occluded surfaces.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
12/07/2016

Template Matching with Deformable Diversity Similarity

We propose a novel measure for template matching named Deformable Divers...
research
11/19/2018

Deep Shape-from-Template: Wide-Baseline, Dense and Fast Registration and Deformable Reconstruction from a Single Image

We present Deep Shape-from-Template (DeepSfT), a novel Deep Neural Netwo...
research
12/22/2022

Deformable Surface Reconstruction via Riemannian Metric Preservation

Estimating the pose of an object from a monocular image is an inverse pr...
research
08/17/2022

MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes

3D human motion capture from monocular RGB images respecting interaction...
research
08/25/2023

Textureless Deformable Surface Reconstruction with Invisible Markers

Reconstructing and tracking deformable surface with little or no texture...
research
04/12/2016

DTM: Deformable Template Matching

A novel template matching algorithm that can incorporate the concept of ...
research
08/27/2022

xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Image

Existing approaches for 3D garment reconstruction either assume a predef...

Please sign up or login with your details

Forgot password? Click here to reset