3DPeople: Modeling the Geometry of Dressed Humans

04/09/2019
by   Albert Pumarola, et al.
0

Recent advances in 3D human shape estimation build upon parametric representations that model very well the shape of the naked body, but are not appropriate to represent the clothing geometry. In this paper, we present an approach to model dressed humans and predict their geometry from single images. We contribute in three fundamental aspects of the problem, namely, a new dataset, a novel shape parameterization algorithm and an end-to-end deep generative network for predicting shape. First, we present 3DPeople, a large-scale synthetic dataset with 2.5 Million photo-realistic images of 80 subjects performing 70 activities and wearing diverse outfits. Besides providing textured 3D meshes for clothes and body, we annotate the dataset with segmentation masks, skeletons, depth, normal maps and optical flow. All this together makes 3DPeople suitable for a plethora of tasks. We then represent the 3D shapes using 2D geometry images. To build these images we propose a novel spherical area-preserving parameterization algorithm based on the optimal mass transportation method. We show this approach to improve existing spherical maps which tend to shrink the elongated parts of the full body models such as the arms and legs, making the geometry images incomplete. Finally, we design a multi-resolution deep generative network that, given an input image of a dressed human, predicts his/her geometry image (and thus the clothed body shape) in an end-to-end manner. We obtain very promising results in jointly capturing body pose and clothing shape, both for synthetic validation and on the wild images.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

research
07/17/2020

3D Human Shape Reconstruction from a Polarization Image

This paper tackles the problem of estimating 3D body shape of clothed hu...
research
07/09/2018

Fashion is Taking Shape: Understanding Clothing Preference Based on Body Shape From Online Sources

To study the correlation between clothing garments and body shape, we co...
research
09/02/2019

FACSIMILE: Fast and Accurate Scans From an Image in Less Than a Second

Current methods for body shape estimation either lack detail or require ...
research
04/13/2021

Shape and Material Capture at Home

In this paper, we present a technique for estimating the geometry and re...
research
09/07/2023

AnthroNet: Conditional Generation of Humans via Anthropometrics

We present a novel human body model formulated by an extensive set of an...
research
08/30/2022

Inferring Implicit 3D Representations from Human Figures on Pictorial Maps

In this work, we present an automated workflow to bring human figures, o...
research
10/11/2022

Human Body Measurement Estimation with Adversarial Augmentation

We present a Body Measurement network (BMnet) for estimating 3D anthropo...

Please sign up or login with your details

Forgot password? Click here to reset