Ref-DVGO: Reflection-Aware Direct Voxel Grid Optimization for an Improved Quality-Efficiency Trade-Off in Reflective Scene Reconstruction

08/16/2023
by   Georgios Kouros, et al.
0

Neural Radiance Fields (NeRFs) have revolutionized the field of novel view synthesis, demonstrating remarkable performance. However, the modeling and rendering of reflective objects remain challenging problems. Recent methods have shown significant improvements over the baselines in handling reflective scenes, albeit at the expense of efficiency. In this work, we aim to strike a balance between efficiency and quality. To this end, we investigate an implicit-explicit approach based on conventional volume rendering to enhance the reconstruction quality and accelerate the training and rendering processes. We adopt an efficient density-based grid representation and reparameterize the reflected radiance in our pipeline. Our proposed reflection-aware approach achieves a competitive quality efficiency trade-off compared to competing methods. Based on our experimental results, we propose and discuss hypotheses regarding the factors influencing the results of density-based methods for reconstructing reflective objects. The source code is available at https://github.com/gkouros/ref-dvgo.

READ FULL TEXT
research
10/26/2022

Streaming Radiance Fields for 3D Video Synthesis

We present an explicit-grid based method for efficiently reconstructing ...
research
05/12/2022

View Synthesis with Sculpted Neural Points

We address the task of view synthesis, which can be posed as recovering ...
research
05/22/2022

ReLU Fields: The Little Non-linearity That Could

In many recent works, multi-layer perceptions (MLPs) have been shown to ...
research
11/25/2021

VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field

Neural Radiance Field (NeRF) is a popular method in data-driven 3D recon...
research
05/07/2023

Multi-Space Neural Radiance Fields

Existing Neural Radiance Fields (NeRF) methods suffer from the existence...
research
12/18/2022

Masked Wavelet Representation for Compact Neural Radiance Fields

Neural radiance fields (NeRF) have demonstrated the potential of coordin...
research
03/31/2023

VDN-NeRF: Resolving Shape-Radiance Ambiguity via View-Dependence Normalization

We propose VDN-NeRF, a method to train neural radiance fields (NeRFs) fo...

Please sign up or login with your details

Forgot password? Click here to reset