FastMESH: Fast Surface Reconstruction by Hexagonal Mesh-based Neural Rendering

05/29/2023
by   Yisu Zhang, et al.
0

Despite the promising results of multi-view reconstruction, the recent neural rendering-based methods, such as implicit surface rendering (IDR) and volume rendering (NeuS), not only incur a heavy computational burden on training but also have the difficulties in disentangling the geometric and appearance. Although having achieved faster training speed than implicit representation and hash coding, the explicit voxel-based method obtains the inferior results on recovering surface. To address these challenges, we propose an effective mesh-based neural rendering approach, named FastMESH, which only samples at the intersection of ray and mesh. A coarse-to-fine scheme is introduced to efficiently extract the initial mesh by space carving. More importantly, we suggest a hexagonal mesh model to preserve surface regularity by constraining the second-order derivatives of vertices, where only low level of positional encoding is engaged for neural rendering. The experiments demonstrate that our approach achieves the state-of-the-art results on both reconstruction and novel view synthesis. Besides, we obtain 10-fold acceleration on training comparing to the implicit representation-based methods.

READ FULL TEXT

page 1

page 2

page 7

page 8

research
11/21/2022

Recovering Fine Details for Neural Implicit Surface Reconstruction

Recent works on implicit neural representations have made significant st...
research
11/22/2022

HashSDF: Accurate Implicit Surfaces with Fast Local Features on Permutohedral Lattices

Neural radiance-density field methods have become increasingly popular f...
research
09/06/2023

Sparse 3D Reconstruction via Object-Centric Ray Sampling

We propose a novel method for 3D object reconstruction from a sparse set...
research
05/12/2023

BundleRecon: Ray Bundle-Based 3D Neural Reconstruction

With the growing popularity of neural rendering, there has been an incre...
research
04/09/2021

Pixel Codec Avatars

Telecommunication with photorealistic avatars in virtual or augmented re...
research
08/21/2022

Vox-Surf: Voxel-based Implicit Surface Representation

Virtual content creation and interaction play an important role in moder...
research
02/05/2016

Efficient Multi-view Performance Capture of Fine-Scale Surface Detail

We present a new effective way for performance capture of deforming mesh...

Please sign up or login with your details

Forgot password? Click here to reset