Unsupervised Person Image Generation with Semantic Parsing Transformation

04/06/2019
by   Sijie Song, et al.
16

In this paper, we address unsupervised pose-guided person image generation, which is known challenging due to non-rigid deformation. Unlike previous methods learning a rock-hard direct mapping between human bodies, we propose a new pathway to decompose the hard mapping into two more accessible subtasks, namely, semantic parsing transformation and appearance generation. Firstly, a semantic generative network is proposed to transform between semantic parsing maps, in order to simplify the non-rigid deformation learning. Secondly, an appearance generative network learns to synthesize semantic-aware textures. Thirdly, we demonstrate that training our framework in an end-to-end manner further refines the semantic maps and final results accordingly. Our method is generalizable to other semantic-aware person image generation tasks, , clothing texture transfer and controlled image manipulation. Experimental results demonstrate the superiority of our method on DeepFashion and Market-1501 datasets, especially in keeping the clothing attributes and better body shapes.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
08/18/2020

Person image generation with semantic attention network for person re-identification

Pose variation is one of the key factors which prevents the network from...
research
06/02/2020

Recapture as You Want

With the increasing prevalence and more powerful camera systems of mobil...
research
11/26/2021

Self-supervised Correlation Mining Network for Person Image Generation

Person image generation aims to perform non-rigid deformation on source ...
research
11/18/2020

MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation

Pose-guided person image generation usually involves using paired source...
research
12/13/2020

Human Pose Transfer by Adaptive Hierarchical Deformation

Human pose transfer, as a misaligned image generation task, is very chal...
research
02/19/2021

Pose Guided Person Image Generation with Hidden p-Norm Regression

In this paper, we propose a novel approach to solve the pose guided pers...
research
12/29/2017

Deformable GANs for Pose-based Human Image Generation

In this paper we address the problem of generating person images conditi...

Please sign up or login with your details

Forgot password? Click here to reset