Unsupervised Shape and Pose Disentanglement for 3D Meshes

07/22/2020
by   Keyang Zhou, et al.
Max Planck Society
5

Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to factor surface variations into shape and pose dependent components. Learning such models requires lots of expert knowledge and hand-defined object-specific constraints, making the learning approach unscalable to novel objects. In this paper, we present a simple yet effective approach to learn disentangled shape and pose representations in an unsupervised setting. We use a combination of self-consistency and cross-consistency constraints to learn pose and shape space from registered meshes. We additionally incorporate as-rigid-as-possible deformation(ARAP) into the training loop to avoid degenerate solutions. We demonstrate the usefulness of learned representations through a number of tasks including pose transfer and shape retrieval. The experiments on datasets of 3D humans, faces, hands and animals demonstrate the generality of our approach. Code is made available at https://virtualhumans.mpi-inf.mpg.de/unsup_shape_pose/.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/18/2022

Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction

The goal of 3D pose transfer is to transfer the pose from the source mes...
08/17/2021

Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfer

With the strength of deep generative models, 3D pose transfer regains in...
05/01/2008

Morphing of Triangular Meshes in Shape Space

We present a novel approach to morph between two isometric poses of the ...
11/16/2021

Coarse-to-fine Animal Pose and Shape Estimation

Most existing animal pose and shape estimation approaches reconstruct an...
06/07/2020

Learning pose variations within shape population by constrained mixtures of factor analyzers

Mining and learning the shape variability of underlying population has b...
12/14/2021

Geometry-Contrastive Transformer for Generalized 3D Pose Transfer

We present a customized 3D mesh Transformer model for the pose transfer ...
08/21/2023

CHORD: Category-level Hand-held Object Reconstruction via Shape Deformation

In daily life, humans utilize hands to manipulate objects. Modeling the ...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset