Human Pose Transfer with Disentangled Feature Consistency

07/23/2021
by   Kun Wu, et al.
3

Deep generative models have made great progress in synthesizing images with arbitrary human poses and transferring poses of one person to others. However, most existing approaches explicitly leverage the pose information extracted from the source images as a conditional input for the generative networks. Meanwhile, they usually focus on the visual fidelity of the synthesized images but neglect the inherent consistency, which further confines their performance of pose transfer. To alleviate the current limitations and improve the quality of the synthesized images, we propose a pose transfer network with Disentangled Feature Consistency (DFC-Net) to facilitate human pose transfer. Given a pair of images containing the source and target person, DFC-Net extracts pose and static information from the source and target respectively, then synthesizes an image of the target person with the desired pose from the source. Moreover, DFC-Net leverages disentangled feature consistency losses in the adversarial training to strengthen the transfer coherence and integrates the keypoint amplifier to enhance the pose feature extraction. Additionally, an unpaired support dataset Mixamo-Sup providing more extra pose information has been further utilized during the training to improve the generality and robustness of DFC-Net. Extensive experimental results on Mixamo-Pose and EDN-10k have demonstrated DFC-Net achieves state-of-the-art performance on pose transfer.

READ FULL TEXT

page 1

page 3

page 8

page 9

page 11

research
12/01/2021

FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer

Human pose transfer aims at transferring the appearance of the source pe...
research
11/22/2022

Person Image Synthesis via Denoising Diffusion Model

The pose-guided person image generation task requires synthesizing photo...
research
03/27/2019

Dense Intrinsic Appearance Flow for Human Pose Transfer

We present a novel approach for the task of human pose transfer, which a...
research
12/13/2020

PoNA: Pose-guided Non-local Attention for Human Pose Transfer

Human pose transfer, which aims at transferring the appearance of a give...
research
03/19/2020

Pose Augmentation: Class-agnostic Object Pose Transformation for Object Recognition

Object pose increases interclass object variance which makes object reco...
research
10/04/2022

Collecting The Puzzle Pieces: Disentangled Self-Driven Human Pose Transfer by Permuting Textures

Human pose transfer aims to synthesize a new view of a person under a gi...
research
07/08/2019

Linking Art through Human Poses

We address the discovery of composition transfer in artworks based on th...

Please sign up or login with your details

Forgot password? Click here to reset