Accurate Human Body Reconstruction for Volumetric Video

02/26/2022
by   Decai Chen, et al.
10

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using traditional stereo matching techniques, we introduce and optimize deep learning-based multi-view stereo networks for depth map estimation in the context of professional volumetric video reconstruction. Furthermore, we propose a novel depth map post-processing approach including filtering and fusion, by taking into account photometric confidence, cross-view geometric consistency, foreground masks as well as camera viewing frustums. We show that our method can generate high levels of geometric detail for reconstructed human bodies.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
07/05/2018

Volumetric performance capture from minimal camera viewpoints

We present a convolutional autoencoder that enables high fidelity volume...
research
08/17/2023

V-FUSE: Volumetric Depth Map Fusion with Long-Range Constraints

We introduce a learning-based depth map fusion framework that accepts a ...
research
05/05/2021

Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors

Human volumetric capture is a long-standing topic in computer vision and...
research
04/12/2021

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision

In this paper, we propose StereoPIFu, which integrates the geometric con...
research
08/08/2019

Semantic Estimation of 3D Body Shape and Pose using Minimal Cameras

We present an approach to accurately estimate high fidelity markerless 3...
research
06/09/2023

Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction

Generating realistic human 3D reconstructions using image or video data ...
research
09/16/2021

Stereo Video Reconstruction Without Explicit Depth Maps for Endoscopic Surgery

We introduce the task of stereo video reconstruction or, equivalently, 2...

Please sign up or login with your details

Forgot password? Click here to reset