PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on

07/27/2022
by   Zhenyu Xie, et al.
6

Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. In this work, we take a step forwards to explore versatile virtual try-on solutions, which we argue should possess three main properties, namely, they should support unsupervised training, arbitrary garment categories, and controllable garment editing. To this end, we propose a characteristic-preserving end-to-end network, the PAtch-routed SpaTially-Adaptive GAN++ (PASTA-GAN++), to achieve a versatile system for high-resolution unpaired virtual try-on. Specifically, our PASTA-GAN++ consists of an innovative patch-routed disentanglement module to decouple the intact garment into normalized patches, which is capable of retaining garment style information while eliminating the garment spatial information, thus alleviating the overfitting issue during unsupervised training. Furthermore, PASTA-GAN++ introduces a patch-based garment representation and a patch-guided parsing synthesis block, allowing it to handle arbitrary garment categories and support local garment editing. Finally, to obtain try-on results with realistic texture details, PASTA-GAN++ incorporates a novel spatially-adaptive residual module to inject the coarse warped garment feature into the generator. Extensive experiments on our newly collected UnPaired virtual Try-on (UPT) dataset demonstrate the superiority of PASTA-GAN++ over existing SOTAs and its ability for controllable garment editing.

READ FULL TEXT

page 2

page 6

page 8

page 10

page 11

page 12

page 13

page 14

research
11/20/2021

Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN

Image-based virtual try-on is one of the most promising applications of ...
research
07/28/2021

Shape Controllable Virtual Try-on for Underwear Models

Image virtual try-on task has abundant applications and has become a hot...
research
08/17/2021

MV-TON: Memory-based Video Virtual Try-on network

With the development of Generative Adversarial Network, image-based virt...
research
05/08/2023

FashionTex: Controllable Virtual Try-on with Text and Texture

Virtual try-on attracts increasing research attention as a promising way...
research
03/24/2023

GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning

Image-based Virtual Try-ON aims to transfer an in-shop garment onto a sp...
research
02/07/2022

Patch-Based Stochastic Attention for Image Editing

Attention mechanisms have become of crucial importance in deep learning ...
research
04/28/2021

InfinityGAN: Towards Infinite-Resolution Image Synthesis

We present InfinityGAN, a method to generate arbitrary-resolution images...

Please sign up or login with your details

Forgot password? Click here to reset