COAP: Compositional Articulated Occupancy of People

04/13/2022
by   Marko Mihajlovic, et al.
14

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which is essential for human motion reconstruction and synthesis in 3D scenes. However, existing neural implicit bodies suffer from either poor generalization on highly articulated poses or slow inference time. In this work, we observe that prior knowledge about the human body's shape and kinematic structure can be leveraged to improve generalization and efficiency. We decompose the full-body geometry into local body parts and employ a part-aware encoder-decoder architecture to learn neural articulated occupancy that models complex deformations locally. Our local shape encoder represents the body deformation of not only the corresponding body part but also the neighboring body parts. The decoder incorporates the geometric constraints of local body shape which significantly improves pose generalization. We demonstrate that our model is suitable for resolving self-intersections and collisions with 3D environments. Quantitative and qualitative experiments show that our method largely outperforms existing solutions in terms of both efficiency and accuracy. The code and models are available at https://neuralbodies.github.io/COAP/index.html

READ FULL TEXT

page 8

page 11

page 12

research
08/19/2021

Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing

We present Neural Generalized Implicit Functions(Neural-GIF), to animate...
research
04/14/2021

LEAP: Learning Articulated Occupancy of People

Substantial progress has been made on modeling rigid 3D objects using de...
research
05/09/2022

Single-view 3D Body and Cloth Reconstruction under Complex Poses

Recent advances in 3D human shape reconstruction from single images have...
research
03/09/2022

Structure-Aware Flow Generation for Human Body Reshaping

Body reshaping is an important procedure in portrait photo retouching. D...
research
06/06/2023

Human 3D Avatar Modeling with Implicit Neural Representation: A Brief Survey

A human 3D avatar is one of the important elements in the metaverse, and...
research
03/15/2021

Learning Compositional Representation for 4D Captures with Neural ODE

Learning based representation has become the key to the success of many ...
research
02/01/2015

Human Re-identification by Matching Compositional Template with Cluster Sampling

This paper aims at a newly raising task in visual surveillance: re-ident...

Please sign up or login with your details

Forgot password? Click here to reset