The Power of Points for Modeling Humans in Clothing

09/02/2021
by   Qianli Ma, et al.
7

Currently it requires an artist to create 3D human avatars with realistic clothing that can move naturally. Despite progress on 3D scanning and modeling of human bodies, there is still no technology that can easily turn a static scan into an animatable avatar. Automating the creation of such avatars would enable many applications in games, social networking, animation, and AR/VR to name a few. The key problem is one of representation. Standard 3D meshes are widely used in modeling the minimally-clothed body but do not readily capture the complex topology of clothing. Recent interest has shifted to implicit surface models for this task but they are computationally heavy and lack compatibility with existing 3D tools. What is needed is a 3D representation that can capture varied topology at high resolution and that can be learned from data. We argue that this representation has been with us all along – the point cloud. Point clouds have properties of both implicit and explicit representations that we exploit to model 3D garment geometry on a human body. We train a neural network with a novel local clothing geometric feature to represent the shape of different outfits. The network is trained from 3D point clouds of many types of clothing, on many bodies, in many poses, and learns to model pose-dependent clothing deformations. The geometry feature can be optimized to fit a previously unseen scan of a person in clothing, enabling the scan to be reposed realistically. Our model demonstrates superior quantitative and qualitative results in both multi-outfit modeling and unseen outfit animation. The code is available for research purposes.

READ FULL TEXT

page 1

page 4

page 15

page 16

research
04/15/2021

SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements

Learning to model and reconstruct humans in clothing is challenging due ...
research
09/14/2022

Neural Point-based Shape Modeling of Humans in Challenging Clothing

Parametric 3D body models like SMPL only represent minimally-clothed peo...
research
06/06/2023

Human 3D Avatar Modeling with Implicit Neural Representation: A Brief Survey

A human 3D avatar is one of the important elements in the metaverse, and...
research
04/16/2021

Point-Based Modeling of Human Clothing

We propose a new approach to human clothing modeling based on point clou...
research
04/06/2023

CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition

Creating animatable avatars from static scans requires the modeling of c...
research
07/22/2020

Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction

Implicit functions represented as deep learning approximations are power...
research
08/21/2023

SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes

We present SCULPT, a novel 3D generative model for clothed and textured ...

Please sign up or login with your details

Forgot password? Click here to reset