SoftSMPL: Data-driven Modeling of Nonlinear Soft-tissue Dynamics for Parametric Humans

04/01/2020
by   Igor Santesteban, et al.
0

We present SoftSMPL, a learning-based method to model realistic soft-tissue dynamics as a function of body shape and motion. Datasets to learn such task are scarce and expensive to generate, which makes training models prone to overfitting. At the core of our method there are three key contributions that enable us to model highly realistic dynamics and better generalization capabilities than state-of-the-art methods, while training on the same data. First, a novel motion descriptor that disentangles the standard pose representation by removing subject-specific features; second, a neural-network-based recurrent regressor that generalizes to unseen shapes and motions; and third, a highly efficient nonlinear deformation subspace capable of representing soft-tissue deformations of arbitrary shapes. We demonstrate qualitative and quantitative improvements over existing methods and, additionally, we show the robustness of our method on a variety of motion capture databases.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 9

research
04/05/2019

AMASS: Archive of Motion Capture as Surface Shapes

Large datasets are the cornerstone of recent advances in computer vision...
research
05/17/2023

Information processing via human soft tissue

This study demonstrates that the soft biological tissues of humans can b...
research
11/26/2021

DSNet: Dynamic Skin Deformation Prediction by Recurrent Neural Network

Skin dynamics contributes to the enriched realism of human body models i...
research
03/26/2019

Learning Soft Tissue Behavior of Organs for Surgical Navigation with Convolutional Neural Networks

Purpose: In surgical navigation, pre-operative organ models are presente...
research
09/23/2022

Motion Guided Deep Dynamic 3D Garments

Realistic dynamic garments on animated characters have many AR/VR applic...
research
03/18/2020

A new geodesic-based feature for characterization of 3D shapes: application to soft tissue organ temporal deformations

In this paper, we propose a method for characterizing 3D shapes from poi...
research
12/21/2020

Data-Driven Geometric System Identification for Shape-Underactuated Dissipative Systems

The study of systems whose movement is both geometric and dissipative of...

Please sign up or login with your details

Forgot password? Click here to reset