WAS-VTON: Warping Architecture Search for Virtual Try-on Network

08/01/2021
by   Zhenyu Xie, et al.
11

Despite recent progress on image-based virtual try-on, current methods are constraint by shared warping networks and thus fail to synthesize natural try-on results when faced with clothing categories that require different warping operations. In this paper, we address this problem by finding clothing category-specific warping networks for the virtual try-on task via Neural Architecture Search (NAS). We introduce a NAS-Warping Module and elaborately design a bilevel hierarchical search space to identify the optimal network-level and operation-level flow estimation architecture. Given the network-level search space, containing different numbers of warping blocks, and the operation-level search space with different convolution operations, we jointly learn a combination of repeatable warping cells and convolution operations specifically for the clothing-person alignment. Moreover, a NAS-Fusion Module is proposed to synthesize more natural final try-on results, which is realized by leveraging particular skip connections to produce better-fused features that are required for seamlessly fusing the warped clothing and the unchanged person part. We adopt an efficient and stable one-shot searching strategy to search the above two modules. Extensive experiments demonstrate that our WAS-VTON significantly outperforms the previous fixed-architecture try-on methods with more natural warping results and virtual try-on results.

READ FULL TEXT

page 1

page 4

page 7

research
05/15/2020

HNAS: Hierarchical Neural Architecture Search on Mobile Devices

Neural Architecture Search (NAS) has attracted growing interest. To redu...
research
03/30/2023

Learning Garment DensePose for Robust Warping in Virtual Try-On

Virtual try-on, i.e making people virtually try new garments, is an acti...
research
04/13/2022

De-IReps: Searching for improved Re-parameterizing Architecture based on Differentiable Evolution Strategy

In recent years, neural architecture search (NAS) has shown great compet...
research
04/01/2020

LGVTON: A Landmark Guided Approach to Virtual Try-On

We address the problem of image based virtual try-on (VTON), where the g...
research
03/22/2020

BS-NAS: Broadening-and-Shrinking One-Shot NAS with Searchable Numbers of Channels

One-Shot methods have evolved into one of the most popular methods in Ne...
research
03/24/2023

GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning

Image-based Virtual Try-ON aims to transfer an in-shop garment onto a sp...
research
06/28/2022

High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions

Image-based virtual try-on aims to synthesize an image of a person weari...

Please sign up or login with your details

Forgot password? Click here to reset