Disentangled Cycle Consistency for Highly-realistic Virtual Try-On

03/17/2021
by   Chongjian Ge, et al.
0

Image virtual try-on replaces the clothes on a person image with a desired in-shop clothes image. It is challenging because the person and the in-shop clothes are unpaired. Existing methods formulate virtual try-on as either in-painting or cycle consistency. Both of these two formulations encourage the generation networks to reconstruct the input image in a self-supervised manner. However, existing methods do not differentiate clothing and non-clothing regions. A straight-forward generation impedes virtual try-on quality because of the heavily coupled image contents. In this paper, we propose a Disentangled Cycle-consistency Try-On Network (DCTON). The DCTON is able to produce highly-realistic try-on images by disentangling important components of virtual try-on including clothes warping, skin synthesis, and image composition. To this end, DCTON can be naturally trained in a self-supervised manner following cycle consistency learning. Extensive experiments on challenging benchmarks show that DCTON outperforms state-of-the-art approaches favorably.

READ FULL TEXT

page 2

page 4

page 6

page 7

page 8

research
10/03/2022

Fill in Fabrics: Body-Aware Self-Supervised Inpainting for Image-Based Virtual Try-On

Previous virtual try-on methods usually focus on aligning a clothing ite...
research
03/30/2023

Learning Garment DensePose for Robust Warping in Virtual Try-On

Virtual try-on, i.e making people virtually try new garments, is an acti...
research
06/04/2019

End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On

The 2D virtual try-on task has recently attracted a lot of interest from...
research
04/18/2023

PG-VTON: A Novel Image-Based Virtual Try-On Method via Progressive Inference Paradigm

Virtual try-on is a promising computer vision topic with a high commerci...
research
07/03/2020

Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-On

The 2D virtual try-on task has recently attracted a great interest from ...
research
08/28/2020

Person-in-Context Synthesiswith Compositional Structural Space

Despite significant progress, controlled generation of complex images wi...
research
03/29/2022

Dressing in the Wild by Watching Dance Videos

While significant progress has been made in garment transfer, one of the...

Please sign up or login with your details

Forgot password? Click here to reset