Motion Guided Deep Dynamic 3D Garments

09/23/2022
by   Meng Zhang, et al.
8

Realistic dynamic garments on animated characters have many AR/VR applications. While authoring such dynamic garment geometry is still a challenging task, data-driven simulation provides an attractive alternative, especially if it can be controlled simply using the motion of the underlying character. In this work, we focus on motion guided dynamic 3D garments, especially for loose garments. In a data-driven setup, we first learn a generative space of plausible garment geometries. Then, we learn a mapping to this space to capture the motion dependent dynamic deformations, conditioned on the previous state of the garment as well as its relative position with respect to the underlying body. Technically, we model garment dynamics, driven using the input character motion, by predicting per-frame local displacements in a canonical state of the garment that is enriched with frame-dependent skinning weights to bring the garment to the global space. We resolve any remaining per-frame collisions by predicting residual local displacements. The resultant garment geometry is used as history to enable iterative rollout prediction. We demonstrate plausible generalization to unseen body shapes and motion inputs, and show improvements over multiple state-of-the-art alternatives.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

page 9

page 10

page 11

research
05/04/2021

Real-time Deep Dynamic Characters

We propose a deep videorealistic 3D human character model displaying hig...
research
02/23/2021

Dynamic Neural Garments

A vital task of the wider digital human effort is the creation of realis...
research
12/12/2022

Markerless Body Motion Capturing for 3D Character Animation based on Multi-view Cameras

This paper proposes a novel application system for the generation of thr...
research
04/01/2020

SoftSMPL: Data-driven Modeling of Nonlinear Soft-tissue Dynamics for Parametric Humans

We present SoftSMPL, a learning-based method to model realistic soft-tis...
research
09/21/2022

Generating Upper-Body Motion for Real-Time Characters Making their Way through Dynamic Environments

Real-time character animation in dynamic environments requires the gener...
research
07/01/2021

Learning-based pose edition for efficient and interactive design

Authoring an appealing animation for a virtual character is a challengin...
research
03/15/2023

Skinned Motion Retargeting with Residual Perception of Motion Semantics Geometry

A good motion retargeting cannot be reached without reasonable considera...

Please sign up or login with your details

Forgot password? Click here to reset