A Pixel-Based Framework for Data-Driven Clothing

12/03/2018
by   Ning Jin, et al.
0

With the aim of creating virtual cloth deformations more similar to real world clothing, we propose a new computational framework that recasts three dimensional cloth deformation as an RGB image in a two dimensional pattern space. Then a three dimensional animation of cloth is equivalent to a sequence of two dimensional RGB images, which in turn are driven/choreographed via animation parameters such as joint angles. This allows us to leverage popular CNNs to learn cloth deformations in image space. The two dimensional cloth pixels are extended into the real world via standard body skinning techniques, after which the RGB values are interpreted as texture offsets and displacement maps. Notably, we illustrate that our approach does not require accurate unclothed body shapes or robust skinning techniques. Additionally, we discuss how standard image based techniques such as image partitioning for higher resolution, GANs for merging partitioned image regions back together, etc., can readily be incorporated into our framework.

READ FULL TEXT

page 4

page 6

page 7

page 8

page 9

page 11

page 12

page 13

research
09/18/2018

Deep Textured 3D Reconstruction of Human Bodies

Recovering textured 3D models of non-rigid human body shapes is challeng...
research
08/20/2020

Monocular Expressive Body Regression through Body-Driven Attention

To understand how people look, interact, or perform tasks, we need to qu...
research
04/08/2016

Infrared Colorization Using Deep Convolutional Neural Networks

This paper proposes a method for transferring the RGB color spectrum to ...
research
03/03/2022

PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence

We present a novel method to learn Personalized Implicit Neural Avatars ...
research
12/10/2019

RGB Point Cloud Manipulation with Triangular Structures for Artistic Image Recoloring

Usual approaches for image recoloring, such as local filtering by transf...
research
07/07/2018

Representing a Partially Observed Non-Rigid 3D Human Using Eigen-Texture and Eigen-Deformation

Reconstruction of the shape and motion of humans from RGB-D is a challen...
research
01/09/2018

RGB image-based data analysis via discrete Morse theory and persistent homology

Understanding and comparing images for the purposes of data analysis is ...

Please sign up or login with your details

Forgot password? Click here to reset