Better Together: Joint Reasoning for Non-rigid 3D Reconstruction with Specularities and Shading

08/04/2017
by   Qi Liu-Yin, et al.
0

We demonstrate the use of shape-from-shading (SfS) to improve both the quality and the robustness of 3D reconstruction of dynamic objects captured by a single camera. Unlike previous approaches that made use of SfS as a post-processing step, we offer a principled integrated approach that solves dynamic object tracking and reconstruction and SfS as a single unified cost function. Moving beyond Lambertian S f S , we propose a general approach that models both specularities and shading while simultaneously tracking and reconstructing general dynamic objects. Solving these problems jointly prevents the kinds of tracking failures which can not be recovered from by pipeline approaches. We show state-of-the-art results both qualitatively and quantitatively.

READ FULL TEXT

page 2

page 4

page 6

page 8

page 9

page 10

page 12

page 13

research
10/21/2020

RigidFusion: Robot Localisation and Mapping in Environments with Large Dynamic Rigid Objects

This work presents a novel approach to simultaneously track a robot with...
research
12/02/2020

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction

We introduce Neural Deformation Graphs for globally-consistent deformati...
research
05/29/2018

Non-rigid Reconstruction with a Single MovingRGB-D Camera

We present a novel non-rigid reconstruction method using a moving RGB-D ...
research
09/30/2020

DOT: Dynamic Object Tracking for Visual SLAM

In this paper we present DOT (Dynamic Object Tracking), a front-end that...
research
05/16/2021

TSDF++: A Multi-Object Formulation for Dynamic Object Tracking and Reconstruction

The ability to simultaneously track and reconstruct multiple objects mov...
research
09/05/2022

Lattice-based shape tracking and servoing of elastic objects

In this paper, we propose a general unified tracking-servoing approach f...
research
09/09/2019

Unified Underwater Structure-from-Motion

This paper shows that accurate underwater 3D shape reconstruction is pos...

Please sign up or login with your details

Forgot password? Click here to reset