Skeleton-free Pose Transfer for Stylized 3D Characters

07/28/2022
by   Zhouyingcheng Liao, et al.
0

We present the first method that automatically transfers poses between stylized 3D characters without skeletal rigging. In contrast to previous attempts to learn pose transformations on fixed or topology-equivalent skeleton templates, our method focuses on a novel scenario to handle skeleton-free characters with diverse shapes, topologies, and mesh connectivities. The key idea of our method is to represent the characters in a unified articulation model so that the pose can be transferred through the correspondent parts. To achieve this, we propose a novel pose transfer network that predicts the character skinning weights and deformation transformations jointly to articulate the target character to match the desired pose. Our method is trained in a semi-supervised manner absorbing all existing character data with paired/unpaired poses and stylized shapes. It generalizes well to unseen stylized characters and inanimate objects. We conduct extensive experiments and demonstrate the effectiveness of our method on this novel task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2023

CTSN: Predicting Cloth Deformation for Skeleton-based Characters with a Two-stream Skinning Network

We present a novel learning method to predict the cloth deformation for ...
research
05/06/2021

Learning Skeletal Articulations with Neural Blend Shapes

Animating a newly designed character using motion capture (mocap) data i...
research
09/03/2021

Neural Human Deformation Transfer

We consider the problem of human deformation transfer, where the goal is...
research
03/29/2021

View-Dependent Formulation of 2.5D Cartoon Models

2.5D cartoon models are methods to simulate three-dimensional (3D)-like ...
research
06/04/2022

APES: Articulated Part Extraction from Sprite Sheets

Rigged puppets are one of the most prevalent representations to create 2...
research
08/22/2019

Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets

We present a learning method for predicting animation skeletons for inpu...
research
03/09/2022

SkinningNet: Two-Stream Graph Convolutional Neural Network for Skinning Prediction of Synthetic Characters

This work presents SkinningNet, an end-to-end Two-Stream Graph Neural Ne...

Please sign up or login with your details

Forgot password? Click here to reset