Neural 3D Scene Compression via Model Compression

05/07/2021
by   Berivan Isik, et al.
7

Rendering 3D scenes requires access to arbitrary viewpoints from the scene. Storage of such a 3D scene can be done in two ways; (1) storing 2D images taken from the 3D scene that can reconstruct the scene back through interpolations, or (2) storing a representation of the 3D scene itself that already encodes views from all directions. So far, traditional 3D compression methods have focused on the first type of storage and compressed the original 2D images with image compression techniques. With this approach, the user first decodes the stored 2D images and then renders the 3D scene. However, this separated procedure is inefficient since a large amount of 2D images have to be stored. In this work, we take a different approach and compress a functional representation of 3D scenes. In particular, we introduce a method to compress 3D scenes by compressing the neural networks that represent the scenes as neural radiance fields. Our method provides more efficient storage of 3D scenes since it does not store 2D images – which are redundant when we render the scene from the neural functional representation.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
04/26/2021

3D Scene Compression through Entropy Penalized Neural Representation Functions

Some forms of novel visual media enable the viewer to explore a 3D scene...
research
06/13/2020

Equivariant Neural Rendering

We propose a framework for learning neural scene representations directl...
research
07/19/2018

Hybrid scene Compression for Visual Localization

Localizing an image wrt. a large scale 3D scene represents a core task f...
research
04/19/2016

Improving Raw Image Storage Efficiency by Exploiting Similarity

To improve the temporal and spatial storage efficiency, researchers have...
research
11/27/2020

Efficient Scene Compression for Visual-based Localization

Estimating the pose of a camera with respect to a 3D reconstruction or s...
research
06/13/2023

Binary Radiance Fields

In this paper, we propose binary radiance fields (BiRF), a storage-effic...
research
06/07/2023

FusedRF: Fusing Multiple Radiance Fields

Radiance Fields (RFs) have shown great potential to represent scenes fro...

Please sign up or login with your details

Forgot password? Click here to reset