3D Pose Transfer with Correspondence Learning and Mesh Refinement

09/30/2021
by   Chaoyue Song, et al.
0

3D pose transfer is one of the most challenging 3D generation tasks. It aims to transfer the pose of a source mesh to a target mesh and keep the identity (e.g., body shape) of the target mesh. Some previous works require key point annotations to build reliable correspondence between the source and target meshes, while other methods do not consider any shape correspondence between sources and targets, which leads to limited generation quality. In this work, we propose a correspondence-refinement network to help the 3D pose transfer for both human and animal meshes. The correspondence between source and target meshes is first established by solving an optimal transport problem. Then, we warp the source mesh according to the dense correspondence and obtain a coarse warped mesh. The warped mesh will be better refined with our proposed Elastic Instance Normalization, which is a conditional normalization layer and can help to generate high-quality meshes. Extensive experimental results show that the proposed architecture can effectively transfer the poses from source to target meshes and produce better results with satisfied visual performance than state-of-the-art methods.

READ FULL TEXT

page 2

page 8

page 17

page 18

page 19

page 20

research
11/18/2022

Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction

The goal of 3D pose transfer is to transfer the pose from the source mes...
research
05/24/2023

Dual-Side Feature Fusion 3D Pose Transfer

3D pose transfer solves the problem of additional input and corresponden...
research
03/16/2020

Neural Pose Transfer by Spatially Adaptive Instance Normalization

Pose transfer has been studied for decades, in which the pose of a sourc...
research
06/23/2023

A Graph Neural Network Approach for Temporal Mesh Blending and Correspondence

We have proposed a self-supervised deep learning framework for solving t...
research
03/20/2023

HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting

We present a simple yet effective method for skeleton-free motion retarg...
research
04/26/2023

MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learning

3D pose transfer is a challenging generation task that aims to transfer ...
research
07/25/2021

Can Action be Imitated? Learn to Reconstruct and Transfer Human Dynamics from Videos

Given a video demonstration, can we imitate the action contained in this...

Please sign up or login with your details

Forgot password? Click here to reset