DeepAI
Log In Sign Up

Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization

05/31/2021
by   Jichao Zhang, et al.
14

Controllable person image generation aims to produce realistic human images with desirable attributes (e.g., the given pose, cloth textures or hair style). However, the large spatial misalignment between the source and target images makes the standard architectures for image-to-image translation not suitable for this task. Most of the state-of-the-art architectures avoid the alignment step during the generation, which causes many artifacts, especially for person images with complex textures. To solve this problem, we introduce a novel Spatially-Adaptive Warped Normalization (SAWN), which integrates a learned flow-field to warp modulation parameters. This allows us to align person spatial-adaptive styles with pose features efficiently. Moreover, we propose a novel self-training part replacement strategy to refine the pretrained model for the texture-transfer task, significantly improving the quality of the generated cloth and the preservation ability of irrelevant regions. Our experimental results on the widely used DeepFashion dataset demonstrate a significant improvement of the proposed method over the state-of-the-art methods on both pose-transfer and texture-transfer tasks. The source code is available at https://github.com/zhangqianhui/Sawn.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 9

page 11

04/14/2021

Learning Semantic Person Image Generation by Region-Adaptive Normalization

Human pose transfer has received great attention due to its wide applica...
04/13/2022

Neural Texture Extraction and Distribution for Controllable Person Image Synthesis

We deal with the controllable person image synthesis task which aims to ...
03/06/2022

Exploring Dual-task Correlation for Pose Guided Person Image Generation

Pose Guided Person Image Generation (PGPIG) is the task of transforming ...
12/01/2021

GLocal: Global Graph Reasoning and Local Structure Transfer for Person Image Generation

In this paper, we focus on person image generation, namely, generating p...
03/27/2020

Controllable Person Image Synthesis with Attribute-Decomposed GAN

This paper introduces the Attribute-Decomposed GAN, a novel generative m...
01/31/2022

Filtering In Neural Implicit Functions

Neural implicit functions are highly effective for representing many kin...
09/27/2022

Im2Oil: Stroke-Based Oil Painting Rendering with Linearly Controllable Fineness Via Adaptive Sampling

This paper proposes a novel stroke-based rendering (SBR) method that tra...

Code Repositories

Sawn

Implementation of 'Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization'


view repo