DeepAI AI Chat
Log In Sign Up

3D Human Shape Reconstruction from a Polarization Image

by   Shihao Zou, et al.

This paper tackles the problem of estimating 3D body shape of clothed humans from single polarized 2D images, i.e. polarization images. Polarization images are known to be able to capture polarized reflected lights that preserve rich geometric cues of an object, which has motivated its recent applications in reconstructing surface normal of the objects of interest. Inspired by the recent advances in human shape estimation from single color images, in this paper, we attempt at estimating human body shapes by leveraging the geometric cues from single polarization images. A dedicated two-stage deep learning approach, SfP, is proposed: given a polarization image, stage one aims at inferring the fined-detailed body surface normal; stage two gears to reconstruct the 3D body shape of clothing details. Empirical evaluations on a synthetic dataset (SURREAL) as well as a real-world dataset (PHSPD) demonstrate the qualitative and quantitative performance of our approach in estimating human poses and shapes. This indicates polarization camera is a promising alternative to the more conventional color or depth imaging for human shape estimation. Further, normal maps inferred from polarization imaging play a significant role in accurately recovering the body shapes of clothed people.


page 8

page 10

page 12

page 14

page 22

page 23

page 26

page 27


Polarization Human Shape and Pose Dataset

Polarization images are known to be able to capture polarized reflected ...

Human Pose and Shape Estimation from Single Polarization Images

This paper focuses on a new problem of estimating human pose and shape f...

3DPeople: Modeling the Geometry of Dressed Humans

Recent advances in 3D human shape estimation build upon parametric repre...

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images

We introduce an approach that accurately reconstructs 3D human poses and...

Deep Polarization Imaging for 3D shape and SVBRDF Acquisition

We present a novel method for efficient acquisition of shape and spatial...

Estimating 3D Human Shapes from Measurements

The recent advances in 3-D imaging technologies give rise to databases o...

Dressing for Diverse Body Shapes

Body shape plays an important role in determining what garments will bes...