SHARP: Shape-Aware Reconstruction of People In Loose Clothing

06/09/2021
by   Sai Sagar Jinka, et al.
0

3D human body reconstruction from monocular images is an interesting and ill-posed problem in computer vision with wider applications in multiple domains. In this paper, we propose SHARP, a novel end-to-end trainable network that accurately recovers the detailed geometry and appearance of 3D people in loose clothing from a monocular image. We propose a sparse and efficient fusion of a parametric body prior with a non-parametric peeled depth map representation of clothed models. The parametric body prior constraints our model in two ways: first, the network retains geometrically consistent body parts that are not occluded by clothing, and second, it provides a body shape context that improves prediction of the peeled depth maps. This enables SHARP to recover fine-grained 3D geometrical details with just L1 losses on the 2D maps, given an input image. We evaluate SHARP on publicly available Cloth3D and THuman datasets and report superior performance to state-of-the-art approaches.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

page 12

research
05/09/2022

Single-view 3D Body and Cloth Reconstruction under Complex Poses

Recent advances in 3D human shape reconstruction from single images have...
research
02/16/2020

PeelNet: Textured 3D reconstruction of human body using single view RGB image

Reconstructing human shape and pose from a single image is a challenging...
research
09/30/2019

DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Compare

We present DenseRaC, a novel end-to-end framework for jointly estimating...
research
04/12/2021

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision

In this paper, we propose StereoPIFu, which integrates the geometric con...
research
07/08/2020

PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction

Modeling 3D humans accurately and robustly from a single image is very c...
research
07/20/2022

CrossHuman: Learning Cross-Guidance from Multi-Frame Images for Human Reconstruction

We propose CrossHuman, a novel method that learns cross-guidance from pa...
research
05/01/2022

The Best of Both Worlds: Combining Model-based and Nonparametric Approaches for 3D Human Body Estimation

Nonparametric based methods have recently shown promising results in rec...

Please sign up or login with your details

Forgot password? Click here to reset