PANeRF: Pseudo-view Augmentation for Improved Neural Radiance Fields Based on Few-shot Inputs

11/23/2022
by   Young Chun Ahn, et al.
0

The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in the hundreds, for generating high-quality images. With a decrease in the number of input views, the rendering quality of NeRF for unseen viewpoints tends to degenerate drastically. To overcome this challenge, we propose pseudo-view augmentation of NeRF, a scheme that expands a sufficient amount of data by considering the geometry of few-shot inputs. We first initialized the NeRF network by leveraging the expanded pseudo-views, which efficiently minimizes uncertainty when rendering unseen views. Subsequently, we fine-tuned the network by utilizing sparse-view inputs containing precise geometry and color information. Through experiments under various settings, we verified that our model faithfully synthesizes novel-view images of superior quality and outperforms existing methods for multi-view datasets.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
03/10/2023

Self-NeRF: A Self-Training Pipeline for Few-Shot Neural Radiance Fields

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method ...
research
08/09/2022

HRF-Net: Holistic Radiance Fields from Sparse Inputs

We present HRF-Net, a novel view synthesis method based on holistic radi...
research
03/17/2023

Single-view Neural Radiance Fields with Depth Teacher

Neural Radiance Fields (NeRF) have been proposed for photorealistic nove...
research
05/12/2022

Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation

Neural Radiance Fields (NeRF) have emerged as a potent paradigm for repr...
research
04/13/2023

NeRFVS: Neural Radiance Fields for Free View Synthesis via Geometry Scaffolds

We present NeRFVS, a novel neural radiance fields (NeRF) based method to...
research
05/01/2018

Adaptive View Planning for Aerial 3D Reconstruction of Complex Scenes

With the proliferation of small aerial vehicles, acquiring close up aeri...
research
09/18/2022

ActiveNeRF: Learning where to See with Uncertainty Estimation

Recently, Neural Radiance Fields (NeRF) has shown promising performances...

Please sign up or login with your details

Forgot password? Click here to reset