Enhance-NeRF: Multiple Performance Evaluation for Neural Radiance Fields

06/08/2023
by   Qianqiu Tan, et al.
4

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate realistic images from any viewpoint. It simultaneously reconstructs the shape, lighting, and materials of objects, and without surface defects, which breaks down the barrier between virtuality and reality. The potential spatial correspondences displayed by NeRF between reconstructed scenes and real-world scenes offer a wide range of practical applications possibilities. Despite significant progress in 3D reconstruction since NeRF were introduced, there remains considerable room for exploration and experimentation. NeRF-based models are susceptible to interference issues caused by colored "fog" noise. Additionally, they frequently encounter instabilities and failures while attempting to reconstruct unbounded scenes. Moreover, the model takes a significant amount of time to converge, making it even more challenging to use in such scenarios. Our approach, coined Enhance-NeRF, which adopts joint color to balance low and high reflectivity objects display, utilizes a decoding architecture with prior knowledge to improve recognition, and employs multi-layer performance evaluation mechanisms to enhance learning capacity. It achieves reconstruction of outdoor scenes within one hour under single-card condition. Based on experimental results, Enhance-NeRF partially enhances fitness capability and provides some support to outdoor scene reconstruction. The Enhance-NeRF method can be used as a plug-and-play component, making it easy to integrate with other NeRF-based models. The code is available at: https://github.com/TANQIanQ/Enhance-NeRF

READ FULL TEXT

page 1

page 4

page 7

page 8

page 9

page 10

page 11

research
10/15/2020

NeRF++: Analyzing and Improving Neural Radiance Fields

Neural Radiance Fields (NeRF) achieve impressive view synthesis results ...
research
01/06/2022

Stay in Touch! Shape and Shadow Influence Surface Contact in XR Displays

The information provided to a person's visual system by extended reality...
research
03/22/2018

Generalized Scene Reconstruction

A new passive approach called Generalized Scene Reconstruction (GSR) ena...
research
10/05/2021

Echo-Reconstruction: Audio-Augmented 3D Scene Reconstruction

Reflective and textureless surfaces such as windows, mirrors, and walls ...
research
07/21/2023

RICo: Rotate-Inpaint-Complete for Generalizable Scene Reconstruction

General scene reconstruction refers to the task of estimating the full 3...
research
03/16/2023

Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation

Implicit neural rendering, which uses signed distance function (SDF) rep...
research
04/15/2019

Performance Evaluation of LTE-CommSense System for Discrimination of Presence of Multiple Objects in Outdoor Environment

LTE-CommSense is a novel instrumentation scheme which analyzes channel a...

Please sign up or login with your details

Forgot password? Click here to reset