Contact-Aware Retargeting of Skinned Motion

09/15/2021
by   Ruben Villegas, et al.
0

This paper introduces a motion retargeting method that preserves self-contacts and prevents interpenetration. Self-contacts, such as when hands touch each other or the torso or the head, are important attributes of human body language and dynamics, yet existing methods do not model or preserve these contacts. Likewise, interpenetration, such as a hand passing into the torso, are a typical artifact of motion estimation methods. The input to our method is a human motion sequence and a target skeleton and character geometry. The method identifies self-contacts and ground contacts in the input motion, and optimizes the motion to apply to the output skeleton, while preserving these contacts and reducing interpenetration. We introduce a novel geometry-conditioned recurrent network with an encoder-space optimization strategy that achieves efficient retargeting while satisfying contact constraints. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works. We also show our method generalizes to motion estimated from human videos where we improve over previous works that produce noticeable interpenetration.

READ FULL TEXT

page 1

page 7

page 8

research
09/29/2019

Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction

Human motion prediction aims to generate future motions based on the obs...
research
03/15/2023

Skinned Motion Retargeting with Residual Perception of Motion Semantics Geometry

A good motion retargeting cannot be reached without reasonable considera...
research
05/24/2022

Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video

We focus on the task of estimating a physically plausible articulated hu...
research
03/20/2023

HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting

We present a simple yet effective method for skeleton-free motion retarg...
research
05/30/2023

HuMoT: Human Motion Representation using Topology-Agnostic Transformers for Character Animation Retargeting

Motion retargeting is the long-standing problem in character animation t...
research
07/17/2020

Personalized Speech2Video with 3D Skeleton Regularization and Expressive Body Poses

In this paper, we propose a novel approach to convert given speech audio...
research
03/28/2022

Semantic Motion Correction Via Iterative Nonlinear Optimization and Animation

Here, we present an end-to-end method to create 2D animation for a goalk...

Please sign up or login with your details

Forgot password? Click here to reset