Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspective

03/01/2018
by   Suryansh Kumar, et al.
0

This paper addresses the task of dense non-rigid structure from motion (NRSfM) using multiple images. State-of-the-art methods to this problem are often hurdled by scalability, expensive computations, and noisy measurements. Further, recent methods to NRSfM usually either assume a small number of sparse feature points or ignore local non-linearities of shape deformations, and thus cannot reliably model complex non-rigid deformations. To address these issues, in this paper, we propose a new approach for dense NRSfM by modeling the problem on a Grassmann manifold. Specifically, we assume the complex non-rigid deformations lie on a union of local linear subspaces both spatially and temporally. This naturally allows for a compact representation of the complex non-rigid deformation over frames. We provide experimental results on several synthetic and real benchmark datasets. The procured results clearly demonstrate that our method, apart from being scalable and more accurate than state-of-the-art methods, is also more robust to noise and generalizes to highly non-linear deformations.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
06/15/2020

Dense Non-Rigid Structure from Motion: A Manifold Viewpoint

Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geome...
research
05/14/2017

Spatial-Temporal Union of Subspaces for Multi-body Non-rigid Structure-from-Motion

Non-rigid structure-from-motion (NRSfM) has so far been mostly studied f...
research
08/15/2017

Monocular Dense 3D Reconstruction of a Complex Dynamic Scene from Two Perspective Frames

This paper proposes a new approach for monocular dense 3D reconstruction...
research
06/27/2017

Dense Non-rigid Structure-from-Motion Made Easy - A Spatial-Temporal Smoothness based Solution

This paper proposes a simple spatial-temporal smoothness based method fo...
research
11/19/2019

Superpixel Soup: Monocular Dense 3D Reconstruction of a Complex Dynamic Scene

This work addresses the task of dense 3D reconstruction of a complex dyn...
research
02/04/2019

Jumping Manifolds: Geometry Aware Dense Non-Rigid Structure from Motion

Given dense image feature correspondences of a non-rigidly moving object...
research
11/23/2020

A Closed-Form Solution to Local Non-Rigid Structure-from-Motion

A recent trend in Non-Rigid Structure-from-Motion (NRSfM) is to express ...

Please sign up or login with your details

Forgot password? Click here to reset