Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedra

04/19/2023
by   Jonáš Kulhánek, et al.
0

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the scene with an MLP. Based on the observation that a (sparse) point cloud of the scene is often available, this paper proposes to use an adaptive representation based on tetrahedra obtained by the Delaunay triangulation instead of the uniform subdivision or point-based representations. We show that such a representation enables efficient training and leads to state-of-the-art results. Our approach elegantly combines concepts from 3D geometry processing, triangle-based rendering, and modern neural radiance fields. Compared to voxel-based representations, ours provides more detail around parts of the scene likely to be close to the surface. Compared to point-based representations, our approach achieves better performance.

READ FULL TEXT

page 5

page 7

page 8

page 11

page 12

page 14

page 16

page 17

research
01/21/2022

Point-NeRF: Point-based Neural Radiance Fields

Volumetric neural rendering methods like NeRF generate high-quality view...
research
07/22/2020

Neural Sparse Voxel Fields

Photo-realistic free-viewpoint rendering of real-world scenes using clas...
research
08/05/2023

NeRFs: The Search for the Best 3D Representation

Neural Radiance Fields or NeRFs have become the representation of choice...
research
11/26/2021

Gradient-SDF: A Semi-Implicit Surface Representation for 3D Reconstruction

We present Gradient-SDF, a novel representation for 3D geometry that com...
research
06/15/2022

VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids

State-of-the-art 3D-aware generative models rely on coordinate-based MLP...
research
09/09/2020

Proactive Estimation of Occlusions and Scene Coverage for Planning Next Best Views in an Unstructured Representation

The process of planning views to observe a scene is known as the Next Be...
research
11/22/2021

Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction

We present a super-fast convergence approach to reconstructing the per-s...

Please sign up or login with your details

Forgot password? Click here to reset