Cross Attention Based Style Distribution for Controllable Person Image Synthesis

08/01/2022
by   Xinyue Zhou, et al.
6

Controllable person image synthesis task enables a wide range of applications through explicit control over body pose and appearance. In this paper, we propose a cross attention based style distribution module that computes between the source semantic styles and target pose for pose transfer. The module intentionally selects the style represented by each semantic and distributes them according to the target pose. The attention matrix in cross attention expresses the dynamic similarities between the target pose and the source styles for all semantics. Therefore, it can be utilized to route the color and texture from the source image, and is further constrained by the target parsing map to achieve a clearer objective. At the same time, to encode the source appearance accurately, the self attention among different semantic styles is also added. The effectiveness of our model is validated quantitatively and qualitatively on pose transfer and virtual try-on tasks.

READ FULL TEXT

page 1

page 5

page 10

page 12

page 21

page 22

page 23

research
12/23/2020

Correspondence Learning for Controllable Person Image Generation

We present a generative model for controllable person image synthesis,as...
research
04/14/2021

Learning Semantic Person Image Generation by Region-Adaptive Normalization

Human pose transfer has received great attention due to its wide applica...
research
04/13/2022

Neural Texture Extraction and Distribution for Controllable Person Image Synthesis

We deal with the controllable person image synthesis task which aims to ...
research
11/19/2022

Single Stage Multi-Pose Virtual Try-On

Multi-pose virtual try-on (MPVTON) aims to fit a target garment onto a p...
research
11/17/2019

Understanding the Teaching Styles by an Attention based Multi-task Cross-media Dimensional modelling

Teaching style plays an influential role in helping students to achieve ...
research
08/24/2020

CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer

While existing makeup style transfer models perform an image synthesis w...
research
02/06/2021

Template-Free Try-on Image Synthesis via Semantic-guided Optimization

The virtual try-on task is so attractive that it has drawn considerable ...

Please sign up or login with your details

Forgot password? Click here to reset