Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields

04/13/2023
by   Jonathan T. Barron, et al.
0

Neural Radiance Field training can be accelerated through the use of grid-based representations in NeRF's learned mapping from spatial coordinates to colors and volumetric density. However, these grid-based approaches lack an explicit understanding of scale and therefore often introduce aliasing, usually in the form of jaggies or missing scene content. Anti-aliasing has previously been addressed by mip-NeRF 360, which reasons about sub-volumes along a cone rather than points along a ray, but this approach is not natively compatible with current grid-based techniques. We show how ideas from rendering and signal processing can be used to construct a technique that combines mip-NeRF 360 and grid-based models such as Instant NGP to yield error rates that are 8 lower than either prior technique, and that trains 24x faster than mip-NeRF 360.

READ FULL TEXT

page 1

page 4

page 8

research
03/24/2021

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields

The rendering procedure used by neural radiance fields (NeRF) samples a ...
research
05/29/2023

Compact Real-time Radiance Fields with Neural Codebook

Reconstructing neural radiance fields with explicit volumetric represent...
research
06/18/2019

Neural Volumes: Learning Dynamic Renderable Volumes from Images

Modeling and rendering of dynamic scenes is challenging, as natural scen...
research
04/20/2023

Multiscale Representation for Real-Time Anti-Aliasing Neural Rendering

The rendering scheme in neural radiance field (NeRF) is effective in ren...
research
03/24/2023

Grid-guided Neural Radiance Fields for Large Urban Scenes

Purely MLP-based neural radiance fields (NeRF-based methods) often suffe...
research
06/01/2023

Analyzing the Internals of Neural Radiance Fields

Modern Neural Radiance Fields (NeRFs) learn a mapping from position to v...
research
06/27/2019

Efficient Spatial Anti-Aliasing Rendering for Line Joins on Vector Maps

The spatial anti-aliasing technique for line joins (intersections of the...

Please sign up or login with your details

Forgot password? Click here to reset