Toward Characteristic-Preserving Image-based Virtual Try-On Network

07/20/2018
by   Bochao Wang, et al.
2

Image-based virtual try-on systems for fitting a new in-shop clothes into a person image have attracted increasing research attention, yet is still challenging. A desirable pipeline should not only transform the target clothes into the most fit shape seamlessly but also preserve well the clothes identity in the generated image, that is, the key characteristics (e.g. texture, logo, embroidery) that depict the original clothes. However, previous image-conditioned generation works fail to meet these critical requirements towards the plausible virtual try-on performance since they fail to handle large spatial misalignment between the input image and target clothes. Prior work explicitly tackled spatial deformation using shape context matching, but failed to preserve clothing details due to its coarse-to-fine strategy. In this work, we propose a new fully-learnable Characteristic-Preserving Virtual Try-On Network (CP-VTON) for addressing all real-world challenges in this task. First, CP-VTON learns a thin-plate spline transformation for transforming the in-shop clothes into fitting the body shape of the target person via a new Geometric Matching Module (GMM) rather than computing correspondences of interest points as prior works did. Second, to alleviate boundary artifacts of warped clothes and make the results more realistic, we employ a Try-On Module that learns a composition mask to integrate the warped clothes and the rendered image to ensure smoothness. Extensive experiments on a fashion dataset demonstrate our CP-VTON achieves the state-of-the-art virtual try-on performance both qualitatively and quantitatively.

READ FULL TEXT

page 2

page 10

page 11

page 13

page 14

research
01/17/2020

SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On

Image-based virtual try-on for fashion has gained considerable attention...
research
04/12/2021

Cloth Interactive Transformer for Virtual Try-On

2D image-based virtual try-on has attracted increased attention from the...
research
11/22/2017

VITON: An Image-based Virtual Try-on Network

We present an image-based VIirtual Try-On Network (VITON) without using ...
research
11/20/2021

Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN

Image-based virtual try-on is one of the most promising applications of ...
research
12/13/2019

Down to the Last Detail: Virtual Try-on with Detail Carving

Virtual try-on under arbitrary poses has attracted lots of research atte...
research
11/24/2021

Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing

Deep learning based virtual try-on system has achieved some encouraging ...
research
05/27/2021

An Efficient Style Virtual Try on Network for Clothing Business Industry

With the increasing development of garment manufacturing industry, the m...

Please sign up or login with your details

Forgot password? Click here to reset