Deep Image Spatial Transformation for Person Image Generation

03/02/2020
by   Yurui Ren, et al.
0

Pose-guided person image generation is to transform a source person image to a target pose. This task requires spatial manipulations of source data. However, Convolutional Neural Networks are limited by lacking the ability to spatially transform the inputs. In this paper, we propose a differentiable global-flow local-attention framework to reassemble the inputs at the feature level. Specifically, our model first calculates the global correlations between sources and targets to predict flow fields. Then, the flowed local patch pairs are extracted from the feature maps to calculate the local attention coefficients. Finally, we warp the source features using a content-aware sampling method with the obtained local attention coefficients. The results of both subjective and objective experiments demonstrate the superiority of our model. Besides, additional results in video animation and view synthesis show that our model is applicable to other tasks requiring spatial transformation. Our source code is available at https://github.com/RenYurui/Global-Flow-Local-Attention.

READ FULL TEXT

page 6

page 7

page 8

page 12

page 13

page 14

page 15

page 16

research
08/27/2020

Deep Spatial Transformation for Pose-Guided Person Image Generation and Animation

Pose-guided person image generation and animation aim to transform a sou...
research
08/04/2021

Combining Attention with Flow for Person Image Synthesis

Pose-guided person image synthesis aims to synthesize person images by t...
research
05/31/2021

Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization

Controllable person image generation aims to produce realistic human ima...
research
03/06/2022

Exploring Dual-task Correlation for Pose Guided Person Image Generation

Pose Guided Person Image Generation (PGPIG) is the task of transforming ...
research
11/12/2022

Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis

We present a novel bipartite graph reasoning Generative Adversarial Netw...
research
11/16/2022

Hierarchical Dynamic Image Harmonization

Image harmonization is a critical task in computer vision, which aims to...
research
08/10/2020

Bipartite Graph Reasoning GANs for Person Image Generation

We present a novel Bipartite Graph Reasoning GAN (BiGraphGAN) for the ch...

Please sign up or login with your details

Forgot password? Click here to reset