CaPhy: Capturing Physical Properties for Animatable Human Avatars

08/11/2023
by   Zhaoqi Su, et al.
0

We present CaPhy, a novel method for reconstructing animatable human avatars with realistic dynamic properties for clothing. Specifically, we aim for capturing the geometric and physical properties of the clothing from real observations. This allows us to apply novel poses to the human avatar with physically correct deformations and wrinkles of the clothing. To this end, we combine unsupervised training with physics-based losses and 3D-supervised training using scanned data to reconstruct a dynamic model of clothing that is physically realistic and conforms to the human scans. We also optimize the physical parameters of the underlying physical model from the scans by introducing gradient constraints of the physics-based losses. In contrast to previous work on 3D avatar reconstruction, our method is able to generalize to novel poses with realistic dynamic cloth deformations. Experiments on several subjects demonstrate that our method can estimate the physical properties of the garments, resulting in superior quantitative and qualitative results compared with previous methods.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
05/25/2010

Physically-based particle simulation and visualization of pastes and gels

This paper is focused on the question of simulation and visualiza- tion ...
research
07/22/2020

Contact and Human Dynamics from Monocular Video

Existing deep models predict 2D and 3D kinematic poses from video that a...
research
10/17/2019

Go with the Flow: Perception-refined Physics Simulation

For many of the physical phenomena around us, we have developed sophisti...
research
04/14/2018

Physics-driven Fire Modeling from Multi-view Images

Fire effects are widely used in various computer graphics applications s...
research
03/26/2022

Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capture

Due to the visual ambiguity, purely kinematic formulations on monocular ...
research
03/24/2021

Beyond Visual Attractiveness: Physically Plausible Single Image HDR Reconstruction for Spherical Panoramas

HDR reconstruction is an important task in computer vision with many ind...
research
05/24/2023

Interactive Neural Resonators

In this work, we propose a method for the controllable synthesis of real...

Please sign up or login with your details

Forgot password? Click here to reset