CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decomposition

04/06/2023
by   Hongwen Zhang, et al.
0

Creating animatable avatars from static scans requires the modeling of clothing deformations in different poses. Existing learning-based methods typically add pose-dependent deformations upon a minimally-clothed mesh template or a learned implicit template, which have limitations in capturing details or hinder end-to-end learning. In this paper, we revisit point-based solutions and propose to decompose explicit garment-related templates and then add pose-dependent wrinkles to them. In this way, the clothing deformations are disentangled such that the pose-dependent wrinkles can be better learned and applied to unseen poses. Additionally, to tackle the seam artifact issues in recent state-of-the-art point-based methods, we propose to learn point features on a body surface, which establishes a continuous and compact feature space to capture the fine-grained and pose-dependent clothing geometry. To facilitate the research in this field, we also introduce a high-quality scan dataset of humans in real-world clothing. Our approach is validated on two existing datasets and our newly introduced dataset, showing better clothing deformation results in unseen poses. The project page with code and dataset can be found at https://www.liuyebin.com/closet.

READ FULL TEXT

page 4

page 7

page 8

page 14

research
07/14/2022

Learning Implicit Templates for Point-Based Clothed Human Modeling

We present FITE, a First-Implicit-Then-Explicit framework for modeling h...
research
04/04/2023

NPC: Neural Point Characters from Video

High-fidelity human 3D models can now be learned directly from videos, t...
research
07/03/2023

VINECS: Video-based Neural Character Skinning

Rigging and skinning clothed human avatars is a challenging task and tra...
research
02/18/2023

Invertible Neural Skinning

Building animatable and editable models of clothed humans from raw 3D sc...
research
04/07/2021

SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks

We present SCANimate, an end-to-end trainable framework that takes raw 3...
research
04/15/2021

SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements

Learning to model and reconstruct humans in clothing is challenging due ...
research
09/02/2021

The Power of Points for Modeling Humans in Clothing

Currently it requires an artist to create 3D human avatars with realisti...

Please sign up or login with your details

Forgot password? Click here to reset