xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Image

08/27/2022
by   Astitva Srivastava, et al.
72

Existing approaches for 3D garment reconstruction either assume a predefined template for the garment geometry (restricting them to fixed clothing styles) or yield vertex colored meshes (lacking high-frequency textural details). Our novel framework co-learns geometric and semantic information of garment surface from the input monocular image for template-free textured 3D garment digitization. More specifically, we propose to extend PeeledHuman representation to predict the pixel-aligned, layered depth and semantic maps to extract 3D garments. The layered representation is further exploited to UV parametrize the arbitrary surface of the extracted garment without any human intervention to form a UV atlas. The texture is then imparted on the UV atlas in a hybrid fashion by first projecting pixels from the input image to UV space for the visible region, followed by inpainting the occluded regions. Thus, we are able to digitize arbitrarily loose clothing styles while retaining high-frequency textural details from a monocular image. We achieve high-fidelity 3D garment reconstruction results on three publicly available datasets and generalization on internet images.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

05/09/2022

Single-view 3D Body and Cloth Reconstruction under Complex Poses

Recent advances in 3D human shape reconstruction from single images have...
07/20/2022

CrossHuman: Learning Cross-Guidance from Multi-Frame Images for Human Reconstruction

We propose CrossHuman, a novel method that learns cross-guidance from pa...
01/30/2022

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

We propose SelfRecon, a clothed human body reconstruction method that co...
03/11/2015

Dense image registration and deformable surface reconstruction in presence of occlusions and minimal texture

Deformable surface tracking from monocular images is well-known to be un...
11/30/2020

Vehicle Reconstruction and Texture Estimation Using Deep Implicit Semantic Template Mapping

We introduce VERTEX, an effective solution to recover 3D shape and intri...
04/19/2022

Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothing

We present PHORHUM, a novel, end-to-end trainable, deep neural network m...
03/29/2021

High-Fidelity and Arbitrary Face Editing

Cycle consistency is widely used for face editing. However, we observe t...