SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction

04/01/2023
by   Yukang Cao, et al.
0

We address the problem of clothed human reconstruction from a single image or uncalibrated multi-view images. Existing methods struggle with reconstructing detailed geometry of a clothed human and often require a calibrated setting for multi-view reconstruction. We propose a flexible framework which, by leveraging the parametric SMPL-X model, can take an arbitrary number of input images to reconstruct a clothed human model under an uncalibrated setting. At the core of our framework is our novel self-evolved signed distance field (SeSDF) module which allows the framework to learn to deform the signed distance field (SDF) derived from the fitted SMPL-X model, such that detailed geometry reflecting the actual clothed human can be encoded for better reconstruction. Besides, we propose a simple method for self-calibration of multi-view images via the fitted SMPL-X parameters. This lifts the requirement of tedious manual calibration and largely increases the flexibility of our method. Further, we introduce an effective occlusion-aware feature fusion strategy to account for the most useful features to reconstruct the human model. We thoroughly evaluate our framework on public benchmarks, demonstrating significant superiority over the state-of-the-arts both qualitatively and quantitatively.

READ FULL TEXT

page 8

page 16

page 18

page 19

page 20

page 21

page 22

page 25

research
08/26/2019

Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Images

We propose a scalable neural network framework to reconstruct the 3D mes...
research
02/21/2023

USR: Unsupervised Separated 3D Garment and Human Reconstruction via Geometry and Semantic Consistency

Dressed people reconstruction from images is a popular task with promisi...
research
07/27/2020

Ladybird: Quasi-Monte Carlo Sampling for Deep Implicit Field Based 3D Reconstruction with Symmetry

Deep implicit field regression methods are effective for 3D reconstructi...
research
03/27/2023

NeUDF: Learning Unsigned Distance Fields from Multi-view Images for Reconstructing Non-watertight Models

Volume rendering-based 3D reconstruction from multi-view images has gain...
research
03/25/2023

PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characters

We propose PAniC-3D, a system to reconstruct stylized 3D character heads...
research
03/26/2023

Geometry-Aware Attenuation Field Learning for Sparse-View CBCT Reconstruction

Cone Beam Computed Tomography (CBCT) is the most widely used imaging met...
research
08/02/2018

Attentional Aggregation of Deep Feature Sets for Multi-view 3D Reconstruction

We study the problem of recovering an underlying 3D shape from a set of ...

Please sign up or login with your details

Forgot password? Click here to reset