VGFlow: Visibility guided Flow Network for Human Reposing

11/13/2022
by   Rishabh Jain, et al.
0

The task of human reposing involves generating a realistic image of a person standing in an arbitrary conceivable pose. There are multiple difficulties in generating perceptually accurate images, and existing methods suffer from limitations in preserving texture, maintaining pattern coherence, respecting cloth boundaries, handling occlusions, manipulating skin generation, etc. These difficulties are further exacerbated by the fact that the possible space of pose orientation for humans is large and variable, the nature of clothing items is highly non-rigid, and the diversity in body shape differs largely among the population. To alleviate these difficulties and synthesize perceptually accurate images, we propose VGFlow. Our model uses a visibility-guided flow module to disentangle the flow into visible and invisible parts of the target for simultaneous texture preservation and style manipulation. Furthermore, to tackle distinct body shapes and avoid network artifacts, we also incorporate a self-supervised patch-wise "realness" loss to improve the output. VGFlow achieves state-of-the-art results as observed qualitatively and quantitatively on different image quality metrics (SSIM, LPIPS, FID).

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

research
10/11/2021

Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistency

Synthesizing images of a person in novel poses from a single image is a ...
research
10/07/2022

Pose Guided Human Image Synthesis with Partially Decoupled GAN

Pose Guided Human Image Synthesis (PGHIS) is a challenging task of trans...
research
09/13/2021

Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN

We present an algorithm for re-rendering a person from a single image un...
research
04/03/2023

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models

We present DreamAvatar, a text-and-shape guided framework for generating...
research
02/28/2023

Video Pose Track with Graph-Guided Sparse Motion Estimation

In this paper, we propose a novel framework for multi-person pose estima...
research
09/14/2021

ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors

Image-based virtual try-on involves synthesizing perceptually convincing...

Please sign up or login with your details

Forgot password? Click here to reset