Learning Intrinsic Images for Clothing

11/16/2021
by   Kuo Jiang, et al.
3

Reconstruction of human clothing is an important task and often relies on intrinsic image decomposition. With a lack of domain-specific data and coarse evaluation metrics, existing models failed to produce satisfying results for graphics applications. In this paper, we focus on intrinsic image decomposition for clothing images and have comprehensive improvements. We collected CloIntrinsics, a clothing intrinsic image dataset, including a synthetic training set and a real-world testing set. A more interpretable edge-aware metric and an annotation scheme is designed for the testing set, which allows diagnostic evaluation for intrinsic models. Finally, we propose ClothInNet model with carefully designed loss terms and an adversarial module. It utilizes easy-to-acquire labels to learn from real-world shading, significantly improves performance with only minor additional annotation effort. We show that our proposed model significantly reduce texture-copying artifacts while retaining surprisingly tiny details, outperforming existing state-of-the-art methods.

READ FULL TEXT

page 3

page 5

page 7

page 8

research
08/26/2018

CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering

Intrinsic image decomposition is a challenging, long-standing computer v...
research
06/29/2020

Intrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image Decomposition

Neural rendering techniques promise efficient photo-realistic image synt...
research
11/20/2020

Intrinsic Image Decomposition using Paradigms

Intrinsic image decomposition is the classical task of mapping image to ...
research
05/02/2017

Shading Annotations in the Wild

Understanding shading effects in images is critical for a variety of vis...
research
07/14/2011

Label-Specific Training Set Construction from Web Resource for Image Annotation

Recently many research efforts have been devoted to image annotation by ...
research
09/03/2020

Physics-based Shading Reconstruction for Intrinsic Image Decomposition

We investigate the use of photometric invariance and deep learning to co...
research
06/01/2023

StyleGAN knows Normal, Depth, Albedo, and More

Intrinsic images, in the original sense, are image-like maps of scene pr...

Please sign up or login with your details

Forgot password? Click here to reset