Compressing Explicit Voxel Grid Representations: fast NeRFs become also small

10/23/2022
by   Chenxi Lola Deng, et al.
0

NeRFs have revolutionized the world of per-scene radiance field reconstruction because of their intrinsic compactness. One of the main limitations of NeRFs is their slow rendering speed, both at training and inference time. Recent research focuses on the optimization of an explicit voxel grid (EVG) that represents the scene, which can be paired with neural networks to learn radiance fields. This approach significantly enhances the speed both at train and inference time, but at the cost of large memory occupation. In this work we propose Re:NeRF, an approach that specifically targets EVG-NeRFs compressibility, aiming to reduce memory storage of NeRF models while maintaining comparable performance. We benchmark our approach with three different EVG-NeRF architectures on four popular benchmarks, showing Re:NeRF's broad usability and effectiveness.

READ FULL TEXT

page 6

page 8

page 15

page 16

page 17

page 18

research
05/29/2023

Compact Real-time Radiance Fields with Neural Codebook

Reconstructing neural radiance fields with explicit volumetric represent...
research
05/15/2023

Curvature-Aware Training for Coordinate Networks

Coordinate networks are widely used in computer vision due to their abil...
research
11/22/2021

Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction

We present a super-fast convergence approach to reconstructing the per-s...
research
09/30/2022

Understanding Pure CLIP Guidance for Voxel Grid NeRF Models

We explore the task of text to 3D object generation using CLIP. Specific...
research
06/10/2022

Improved Direct Voxel Grid Optimization for Radiance Fields Reconstruction

In this technical report, we improve the DVGO framework (called DVGOv2),...
research
03/28/2023

Adaptive Voronoi NeRFs

Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a...
research
12/02/2021

Fast Neural Representations for Direct Volume Rendering

Despite the potential of neural scene representations to effectively com...

Please sign up or login with your details

Forgot password? Click here to reset