imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose

08/24/2021
by   Thiemo Alldieck, et al.
9

We present imGHUM, the first holistic generative model of 3D human shape and articulated pose, represented as a signed distance function. In contrast to prior work, we model the full human body implicitly as a function zero-level-set and without the use of an explicit template mesh. We propose a novel network architecture and a learning paradigm, which make it possible to learn a detailed implicit generative model of human pose, shape, and semantics, on par with state-of-the-art mesh-based models. Our model features desired detail for human models, such as articulated pose including hand motion and facial expressions, a broad spectrum of shape variations, and can be queried at arbitrary resolutions and spatial locations. Additionally, our model has attached spatial semantics making it straightforward to establish correspondences between different shape instances, thus enabling applications that are difficult to tackle using classical implicit representations. In extensive experiments, we demonstrate the model accuracy and its applicability to current research problems.

READ FULL TEXT

page 6

page 8

page 12

page 13

page 15

research
07/31/2019

Learning to Dress 3D People in Generative Clothing

Three-dimensional human body models are widely used in the analysis of h...
research
11/21/2022

An Implicit Parametric Morphable Dental Model

3D Morphable models of the human body capture variations among subjects ...
research
12/13/2021

Learning Body-Aware 3D Shape Generative Models

The shape of many objects in the built environment is dictated by their ...
research
06/30/2023

Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view

From an image of a person, we can easily infer the natural 3D pose and s...
research
09/09/2023

VeRi3D: Generative Vertex-based Radiance Fields for 3D Controllable Human Image Synthesis

Unsupervised learning of 3D-aware generative adversarial networks has la...
research
03/27/2015

A System View of the Recognition and Interpretation of Observed Human Shape, Pose and Action

There is physiological evidence that our ability to interpret human pose...
research
02/02/2023

IKOL: Inverse kinematics optimization layer for 3D human pose and shape estimation via Gauss-Newton differentiation

This paper presents an inverse kinematic optimization layer (IKOL) for 3...

Please sign up or login with your details

Forgot password? Click here to reset