Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On

by   Raquel Vidaurre, et al.

We present a learning-based approach for virtual try-on applications based on a fully convolutional graph neural network. In contrast to existing data-driven models, which are trained for a specific garment or mesh topology, our fully convolutional model can cope with a large family of garments, represented as parametric predefined 2D panels with arbitrary mesh topology, including long dresses, shirts, and tight tops. Under the hood, our novel geometric deep learning approach learns to drape 3D garments by decoupling the three different sources of deformations that condition the fit of clothing: garment type, target body shape, and material. Specifically, we first learn a regressor that predicts the 3D drape of the input parametric garment when worn by a mean body shape. Then, after a mesh topology optimization step where we generate a sufficient level of detail for the input garment type, we further deform the mesh to reproduce deformations caused by the target body shape. Finally, we predict fine-scale details such as wrinkles that depend mostly on the garment material. We qualitatively and quantitatively demonstrate that our fully convolutional approach outperforms existing methods in terms of generalization capabilities and memory requirements, and therefore it opens the door to more general learning-based models for virtual try-on applications.



There are no comments yet.


page 5

page 6

page 9


Learning-Based Animation of Clothing for Virtual Try-On

This paper presents a learning-based clothing animation method for highl...

Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On

We propose a new generative model for 3D garment deformations that enabl...

Toward Characteristic-Preserving Image-based Virtual Try-On Network

Image-based virtual try-on systems for fitting a new in-shop clothes int...

Bridge the Gap Between Model-based and Model-free Human Reconstruction

It is challenging to directly estimate the geometry of human from a sing...

Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels

Learning latent representations of registered meshes is useful for many ...

Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing

Deep learning based virtual try-on system has achieved some encouraging ...

Learning Bidirectional LSTM Networks for Synthesizing 3D Mesh Animation Sequences

In this paper, we present a novel method for learning to synthesize 3D m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.