DeepAI AI Chat
Log In Sign Up

LASR: Learning Articulated Shape Reconstruction from a Monocular Video

by   Gengshan Yang, et al.

Remarkable progress has been made in 3D reconstruction of rigid structures from a video or a collection of images. However, it is still challenging to reconstruct nonrigid structures from RGB inputs, due to its under-constrained nature. While template-based approaches, such as parametric shape models, have achieved great success in modeling the "closed world" of known object categories, they cannot well handle the "open-world" of novel object categories or outlier shapes. In this work, we introduce a template-free approach to learn 3D shapes from a single video. It adopts an analysis-by-synthesis strategy that forward-renders object silhouette, optical flow, and pixel values to compare with video observations, which generates gradients to adjust the camera, shape and motion parameters. Without using a category-specific shape template, our method faithfully reconstructs nonrigid 3D structures from videos of human, animals, and objects of unknown classes. Code will be available at .


page 3

page 5

page 6

page 7


DOVE: Learning Deformable 3D Objects by Watching Videos

Learning deformable 3D objects from 2D images is an extremely ill-posed ...

Stereo 3D Object Trajectory Reconstruction

We present a method to reconstruct the three-dimensional trajectory of a...

Class-agnostic Reconstruction of Dynamic Objects from Videos

We introduce REDO, a class-agnostic framework to REconstruct the Dynamic...

3D Reconstruction of Whole Stomach from Endoscope Video Using Structure-from-Motion

Gastric endoscopy is a common clinical practice that enables medical doc...

Learning monocular 3D reconstruction of articulated categories from motion

Monocular 3D reconstruction of articulated object categories is challeng...

φ-SfT: Shape-from-Template with a Physics-Based Deformation Model

Shape-from-Template (SfT) methods estimate 3D surface deformations from ...

Unsupervised Severely Deformed Mesh Reconstruction (DMR) from a Single-View Image

Much progress has been made in the supervised learning of 3D reconstruct...