VITON: An Image-based Virtual Try-on Network

by   Xintong Han, et al.

We present an image-based VIirtual Try-On Network (VITON) without using 3D information in any form, which seamlessly transfers a desired clothing item onto the corresponding region of a person using a coarse-to-fine strategy. Conditioned upon a new clothing-agnostic yet descriptive person representation, our framework first generates a coarse synthesized image with the target clothing item overlaid on that same person in the same pose. We further enhance the initial blurry clothing area with a refinement network. The network is trained to learn how much detail to utilize from the target clothing item, and where to apply to the person in order to synthesize a photo-realistic image in which the target item deforms naturally with clear visual patterns. Experiments on our newly collected Zalando dataset demonstrate its promise in the image-based virtual try-on task over state-of-the-art generative models.



There are no comments yet.


page 1

page 3

page 4

page 5

page 7

page 8


Data Augmentation using Random Image Cropping for High-resolution Virtual Try-On (VITON-CROP)

Image-based virtual try-on provides the capacity to transfer a clothing ...

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On

Image-based virtual try-on for fashion has gained considerable attention...

VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization

The task of image-based virtual try-on aims to transfer a target clothin...

GarmentGAN: Photo-realistic Adversarial Fashion Transfer

The garment transfer problem comprises two tasks: learning to separate a...

End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On

The 2D virtual try-on task has recently attracted a lot of interest from...

Per Garment Capture and Synthesis for Real-time Virtual Try-on

Virtual try-on is a promising application of computer graphics and human...

Shape Controllable Virtual Try-on for Underwear Models

Image virtual try-on task has abundant applications and has become a hot...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.