PatchShading: High-Quality Human Reconstruction by Patch Warping and Shading Refinement

11/26/2022
by   Lixiang Lin, et al.
0

Human reconstruction from multi-view images plays an important role in many applications. Although neural rendering methods have achieved promising results on synthesising realistic images, it is still difficult to handle the ambiguity between the geometry and appearance using only rendering loss. Moreover, it is very computationally intensive to render a whole image as each pixel requires a forward network inference. To tackle these challenges, we propose a novel approach called PatchShading to reconstruct high-quality mesh of human body from multi-view posed images. We first present a patch warping strategy to constrain multi-view photometric consistency explicitly. Second, we adopt sphere harmonics (SH) illumination and shape from shading image formation to further refine the geometric details. By taking advantage of the oriented point clouds shape representation and SH shading, our proposed method significantly reduce the optimization and rendering time compared to those implicit methods. The encouraging results on both synthetic and real-world datasets demonstrate the efficacy of our proposed approach.

READ FULL TEXT

page 1

page 7

page 8

page 13

research
08/26/2019

Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Images

We propose a scalable neural network framework to reconstruct the 3D mes...
research
05/25/2022

Efficient Textured Mesh Recovery from Multiple Views with Differentiable Rendering

Despite of the promising results on shape and color recovery using self-...
research
06/02/2021

Translational Symmetry-Aware Facade Parsing for 3D Building Reconstruction

Effectively parsing the facade is essential to 3D building reconstructio...
research
04/15/2021

Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance

Reconstructing an object's high-quality 3D shape with inherent spectral ...
research
03/06/2023

A Review of Deep Learning-Powered Mesh Reconstruction Methods

With the recent advances in hardware and rendering techniques, 3D models...
research
12/17/2021

Improving neural implicit surfaces geometry with patch warping

Neural implicit surfaces have become an important technique for multi-vi...
research
12/05/2021

Implicit Neural Deformation for Multi-View Face Reconstruction

In this work, we present a new method for 3D face reconstruction from mu...

Please sign up or login with your details

Forgot password? Click here to reset