NeRFuser: Large-Scale Scene Representation by NeRF Fusion

05/22/2023
by   Jiading Fang, et al.
5

A practical benefit of implicit visual representations like Neural Radiance Fields (NeRFs) is their memory efficiency: large scenes can be efficiently stored and shared as small neural nets instead of collections of images. However, operating on these implicit visual data structures requires extending classical image-based vision techniques (e.g., registration, blending) from image sets to neural fields. Towards this goal, we propose NeRFuser, a novel architecture for NeRF registration and blending that assumes only access to pre-generated NeRFs, and not the potentially large sets of images used to generate them. We propose registration from re-rendering, a technique to infer the transformation between NeRFs based on images synthesized from individual NeRFs. For blending, we propose sample-based inverse distance weighting to blend visual information at the ray-sample level. We evaluate NeRFuser on public benchmarks and a self-collected object-centric indoor dataset, showing the robustness of our method, including to views that are challenging to render from the individual source NeRFs.

READ FULL TEXT

page 1

page 3

page 7

research
10/15/2022

IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields

We propose IBL-NeRF, which decomposes the neural radiance fields (NeRF) ...
research
11/03/2022

nerf2nerf: Pairwise Registration of Neural Radiance Fields

We introduce a technique for pairwise registration of neural fields that...
research
11/29/2021

HDR-NeRF: High Dynamic Range Neural Radiance Fields

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recov...
research
08/08/2023

Implicit neural representations for joint decomposition and registration of gene expression images in the marmoset brain

We propose a novel image registration method based on implicit neural re...
research
08/04/2022

360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360^∘ Radiance Fields

Neural radiance field (NeRF) has recently achieved impressive results in...
research
04/16/2022

Stress-Testing LiDAR Registration

Point cloud registration (PCR) is an important task in many fields inclu...
research
12/15/2020

Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignment

The present paper reviews the classical problem of free-form curve regis...

Please sign up or login with your details

Forgot password? Click here to reset