ClothFit: Cloth-Human-Attribute Guided Virtual Try-On Network Using 3D Simulated Dataset

06/24/2023
by   Yunmin Cho, et al.
0

Online clothing shopping has become increasingly popular, but the high rate of returns due to size and fit issues has remained a major challenge. To address this problem, virtual try-on systems have been developed to provide customers with a more realistic and personalized way to try on clothing. In this paper, we propose a novel virtual try-on method called ClothFit, which can predict the draping shape of a garment on a target body based on the actual size of the garment and human attributes. Unlike existing try-on models, ClothFit considers the actual body proportions of the person and available cloth sizes for clothing virtualization, making it more appropriate for current online apparel outlets. The proposed method utilizes a U-Net-based network architecture that incorporates cloth and human attributes to guide the realistic virtual try-on synthesis. Specifically, we extract features from a cloth image using an auto-encoder and combine them with features from the user's height, weight, and cloth size. The features are concatenated with the features from the U-Net encoder, and the U-Net decoder synthesizes the final virtual try-on image. Our experimental results demonstrate that ClothFit can significantly improve the existing state-of-the-art methods in terms of photo-realistic virtual try-on results.

READ FULL TEXT

page 2

page 4

research
10/16/2022

Realistic, Animatable Human Reconstructions for Virtual Fit-On

We present an end-to-end virtual try-on pipeline, that can fit different...
research
03/31/2021

VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization

The task of image-based virtual try-on aims to transfer a target clothin...
research
11/16/2021

Data Augmentation using Random Image Cropping for High-resolution Virtual Try-On (VITON-CROP)

Image-based virtual try-on provides the capacity to transfer a clothing ...
research
09/10/2021

Per Garment Capture and Synthesis for Real-time Virtual Try-on

Virtual try-on is a promising application of computer graphics and human...
research
03/22/2020

Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps

A virtual try-on method takes a product image and an image of a model an...
research
05/28/2022

Estimation of 3D Body Shape and Clothing Measurements from Frontal- and Side-view Images

The estimation of 3D human body shape and clothing measurements is cruci...
research
05/10/2022

WG-VITON: Wearing-Guide Virtual Try-On for Top and Bottom Clothes

Studies of virtual try-on (VITON) have been shown their effectiveness in...

Please sign up or login with your details

Forgot password? Click here to reset