Pose Guided Multi-person Image Generation From Text

03/09/2022
by   Soon Yau Cheong, et al.
2

Transformers have recently been shown to generate high quality images from texts. However, existing methods struggle to create high fidelity full-body images, especially multiple people. A person's pose has a high degree of freedom that is difficult to describe using words only; this creates errors in the generated image, such as incorrect body proportions and pose. We propose a pose-guided text-to-image model, using pose as an additional input constraint. Using the proposed Keypoint Pose Encoding (KPE) to encode human pose into low dimensional representation, our model can generate novel multi-person images accurately representing the pose and text descriptions provided, with minimal errors. We demonstrate that KPE is invariant to changes in the target image domain and image resolution; we show results on the Deepfashion dataset and create a new multi-person Deepfashion dataset to demonstrate the multi-capabilities of our approach.

READ FULL TEXT

page 7

page 11

page 13

research
05/25/2017

Pose Guided Person Image Generation

This paper proposes the novel Pose Guided Person Generation Network (PG^...
research
04/18/2023

UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer

Existing person image generative models can do either image generation o...
research
07/24/2022

TIPS: Text-Induced Pose Synthesis

In computer vision, human pose synthesis and transfer deal with probabil...
research
04/10/2019

Text Guided Person Image Synthesis

This paper presents a novel method to manipulate the visual appearance (...
research
05/06/2021

Digital Voodoo Dolls

An institution, be it a body of government, commercial enterprise, or a ...
research
02/14/2022

Multi-scale Attention Guided Pose Transfer

Pose transfer refers to the probabilistic image generation of a person w...
research
02/06/2022

Portrait Segmentation Using Deep Learning

A portrait is a painting, drawing, photograph, or engraving of a person,...

Please sign up or login with your details

Forgot password? Click here to reset