Human Pose Transfer by Adaptive Hierarchical Deformation

12/13/2020
by   Jinsong Zhang, et al.
0

Human pose transfer, as a misaligned image generation task, is very challenging. Existing methods cannot effectively utilize the input information, which often fail to preserve the style and shape of hair and clothes. In this paper, we propose an adaptive human pose transfer network with two hierarchical deformation levels. The first level generates human semantic parsing aligned with the target pose, and the second level generates the final textured person image in the target pose with the semantic guidance. To avoid the drawback of vanilla convolution that treats all the pixels as valid information, we use gated convolution in both two levels to dynamically select the important features and adaptively deform the image layer by layer. Our model has very few parameters and is fast to converge. Experimental results demonstrate that our model achieves better performance with more consistent hair, face and clothes with fewer parameters than state-of-the-art methods. Furthermore, our method can be applied to clothing texture transfer.

READ FULL TEXT

page 1

page 5

page 6

page 8

page 9

page 10

page 11

page 12

research
03/06/2021

PISE: Person Image Synthesis and Editing with Decoupled GAN

Person image synthesis, e.g., pose transfer, is a challenging problem du...
research
12/13/2020

PoNA: Pose-guided Non-local Attention for Human Pose Transfer

Human pose transfer, which aims at transferring the appearance of a give...
research
12/01/2021

FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer

Human pose transfer aims at transferring the appearance of the source pe...
research
04/06/2019

Unsupervised Person Image Generation with Semantic Parsing Transformation

In this paper, we address unsupervised pose-guided person image generati...
research
09/24/2021

A 3D Mesh-based Lifting-and-Projection Network for Human Pose Transfer

Human pose transfer has typically been modeled as a 2D image-to-image tr...
research
05/21/2020

Wish You Were Here: Context-Aware Human Generation

We present a novel method for inserting objects, specifically humans, in...
research
10/04/2022

Collecting The Puzzle Pieces: Disentangled Self-Driven Human Pose Transfer by Permuting Textures

Human pose transfer aims to synthesize a new view of a person under a gi...

Please sign up or login with your details

Forgot password? Click here to reset