Drone-NeRF: Efficient NeRF Based 3D Scene Reconstruction for Large-Scale Drone Survey

08/30/2023
by   Zhihao Jia, et al.
0

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the Drone-NeRF framework to enhance the efficient reconstruction of unbounded large-scale scenes suited for drone oblique photography using Neural Radiance Fields (NeRF). Our approach involves dividing the scene into uniform sub-blocks based on camera position and depth visibility. Sub-scenes are trained in parallel using NeRF, then merged for a complete scene. We refine the model by optimizing camera poses and guiding NeRF with a uniform sampler. Integrating chosen samples enhances accuracy. A hash-coded fusion MLP accelerates density representation, yielding RGB and Depth outputs. Our framework accounts for sub-scene constraints, reduces parallel-training noise, handles shadow occlusion, and merges sub-regions for a polished rendering result. This Drone-NeRF framework demonstrates promising capabilities in addressing challenges related to scene complexity, rendering efficiency, and accuracy in drone-obtained imagery.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 9

page 10

page 11

page 13

research
03/21/2022

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

While NeRF has shown great success for neural reconstruction and renderi...
research
12/20/2021

Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs

We use neural radiance fields (NeRFs) to build interactive 3D environmen...
research
10/21/2022

An Exploration of Neural Radiance Field Scene Reconstruction: Synthetic, Real-world and Dynamic Scenes

This project presents an exploration into 3D scene reconstruction of syn...
research
03/24/2023

Grid-guided Neural Radiance Fields for Large Urban Scenes

Purely MLP-based neural radiance fields (NeRF-based methods) often suffe...
research
04/03/2023

RePAST: Relative Pose Attention Scene Representation Transformer

The Scene Representation Transformer (SRT) is a recent method to render ...
research
04/07/2021

VGF-Net: Visual-Geometric Fusion Learning for Simultaneous Drone Navigation and Height Mapping

The drone navigation requires the comprehensive understanding of both vi...
research
03/21/2023

Pre-NeRF 360: Enriching Unbounded Appearances for Neural Radiance Fields

Neural radiance fields (NeRF) appeared recently as a powerful tool to ge...

Please sign up or login with your details

Forgot password? Click here to reset