SparseFusion: Dynamic Human Avatar Modeling from Sparse RGBD Images

by   Xinxin Zuo, et al.

In this paper, we propose a novel approach to reconstruct 3D human body shapes based on a sparse set of RGBD frames using a single RGBD camera. We specifically focus on the realistic settings where human subjects move freely during the capture. The main challenge is how to robustly fuse these sparse frames into a canonical 3D model, under pose changes and surface occlusions. This is addressed by our new framework consisting of the following steps. First, based on a generative human template, for every two frames having sufficient overlap, an initial pairwise alignment is performed; It is followed by a global non-rigid registration procedure, in which partial results from RGBD frames are collected into a unified 3D shape, under the guidance of correspondences from the pairwise alignment; Finally, the texture map of the reconstructed human model is optimized to deliver a clear and spatially consistent texture. Empirical evaluations on synthetic and real datasets demonstrate both quantitatively and qualitatively the superior performance of our framework in reconstructing complete 3D human models with high fidelity. It is worth noting that our framework is flexible, with potential applications going beyond shape reconstruction. As an example, we showcase its use in reshaping and reposing to a new avatar.


page 3

page 6

page 7

page 8

page 9

page 10

page 11

page 13


Deep Textured 3D Reconstruction of Human Bodies

Recovering textured 3D models of non-rigid human body shapes is challeng...

3DBooSTeR: 3D Body Shape and Texture Recovery

We propose 3DBooSTeR, a novel method to recover a textured 3D body mesh ...

Robust 3D Human Motion Reconstruction Via Dynamic Template Construction

In multi-view human body capture systems, the recovered 3D geometry or e...

PoseFusion2: Simultaneous Background Reconstruction and Human Shape Recovery in Real-time

Dynamic environments that include unstructured moving objects pose a har...

Spatiotemporal Texture Reconstruction for Dynamic Objects Using a Single RGB-D Camera

This paper presents an effective method for generating a spatiotemporal ...

Model-based Outdoor Performance Capture

We propose a new model-based method to accurately reconstruct human perf...

Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields

Neural Radiance Fields (NeRF) have achieved photorealistic novel views s...

Please sign up or login with your details

Forgot password? Click here to reset