DeepAI AI Chat
Log In Sign Up

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields

03/24/2021
by   Jonathan T. Barron, et al.
0

The rendering procedure used by neural radiance fields (NeRF) samples a scene with a single ray per pixel and may therefore produce renderings that are excessively blurred or aliased when training or testing images observe scene content at different resolutions. The straightforward solution of supersampling by rendering with multiple rays per pixel is impractical for NeRF, because rendering each ray requires querying a multilayer perceptron hundreds of times. Our solution, which we call "mip-NeRF" (a la "mipmap"), extends NeRF to represent the scene at a continuously-valued scale. By efficiently rendering anti-aliased conical frustums instead of rays, mip-NeRF reduces objectionable aliasing artifacts and significantly improves NeRF's ability to represent fine details, while also being 7 NeRF, mip-NeRF reduces average error rates by 17 NeRF and by 60 present. Mip-NeRF is also able to match the accuracy of a brute-force supersampled NeRF on our multiscale dataset while being 22x faster.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 9

page 12

page 13

page 15

04/20/2023

Multiscale Representation for Real-Time Anti-Aliasing Neural Rendering

The rendering scheme in neural radiance field (NeRF) is effective in ren...
07/21/2023

Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields

Despite the tremendous progress in neural radiance fields (NeRF), we sti...
04/13/2023

Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields

Neural Radiance Field training can be accelerated through the use of gri...
03/28/2023

Adaptive Voronoi NeRFs

Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a...
03/25/2021

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

NeRF synthesizes novel views of a scene with unprecedented quality by fi...
11/05/2021

TermiNeRF: Ray Termination Prediction for Efficient Neural Rendering

Volume rendering using neural fields has shown great promise in capturin...
08/11/2023

Focused Specific Objects NeRF

Most NeRF-based models are designed for learning the entire scene, and c...