Point-NeRF: Point-based Neural Radiance Fields

01/21/2022
by   Qiangeng Xu, et al.
0

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct scene geometry via direct network inference. Point-NeRF combines the advantages of these two approaches by using neural 3D point clouds, with associated neural features, to model a radiance field. Point-NeRF can be rendered efficiently by aggregating neural point features near scene surfaces, in a ray marching-based rendering pipeline. Moreover, Point-NeRF can be initialized via direct inference of a pre-trained deep network to produce a neural point cloud; this point cloud can be finetuned to surpass the visual quality of NeRF with 30X faster training time. Point-NeRF can be combined with other 3D reconstruction methods and handles the errors and outliers in such methods via a novel pruning and growing mechanism.

READ FULL TEXT

page 1

page 7

page 9

page 14

page 15

research
09/06/2021

Point-Based Neural Rendering with Per-View Optimization

There has recently been great interest in neural rendering methods. Some...
research
04/19/2023

Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedra

Neural Radiance Fields (NeRFs) are a very recent and very popular approa...
research
01/03/2023

Neural Point Catacaustics for Novel-View Synthesis of Reflections

View-dependent effects such as reflections pose a substantial challenge ...
research
12/10/2019

Neural Point Cloud Rendering via Multi-Plane Projection

We present a new deep point cloud rendering pipeline through multi-plane...
research
03/28/2019

A Fast Free-viewpoint Video Synthesis Algorithm for Sports Scenes

In this paper, we report on a parallel freeviewpoint video synthesis alg...
research
07/20/2023

PAPR: Proximity Attention Point Rendering

Learning accurate and parsimonious point cloud representations of scene ...
research
05/12/2023

BundleRecon: Ray Bundle-Based 3D Neural Reconstruction

With the growing popularity of neural rendering, there has been an incre...

Please sign up or login with your details

Forgot password? Click here to reset