Floaters No More: Radiance Field Gradient Scaling for Improved Near-Camera Training

05/04/2023
by   Julien Philip, et al.
0

NeRF acquisition typically requires careful choice of near planes for the different cameras or suffers from background collapse, creating floating artifacts on the edges of the captured scene. The key insight of this work is that background collapse is caused by a higher density of samples in regions near cameras. As a result of this sampling imbalance, near-camera volumes receive significantly more gradients, leading to incorrect density buildup. We propose a gradient scaling approach to counter-balance this sampling imbalance, removing the need for near planes, while preventing background collapse. Our method can be implemented in a few lines, does not induce any significant overhead, and is compatible with most NeRF implementations.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

page 9

research
07/04/2022

Adversarial Pairwise Reverse Attention for Camera Performance Imbalance in Person Re-identification: New Dataset and Metrics

Existing evaluation metrics for Person Re-Identification (Person ReID) m...
research
04/20/2023

Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs

Casually captured Neural Radiance Fields (NeRFs) suffer from artifacts s...
research
06/28/2023

A systematic study of the foreground-background imbalance problem in deep learning for object detection

The class imbalance problem in deep learning has been explored in severa...
research
12/21/2019

Eliminating cross-camera bias for vehicle re-identification

Vehicle re-identification (reID) often requires recognize a target vehic...
research
03/31/2021

Near-field Sensing Architecture for Low-Speed Vehicle Automation using a Surround-view Fisheye Camera System

Cameras are the primary sensor in automated driving systems. They provid...
research
11/28/2022

Graph Convolutional Network for Multi-Target Multi-Camera Vehicle Tracking

This letter focuses on the task of Multi-Target Multi-Camera vehicle tra...
research
03/30/2023

A Novel and Fully Automated Domain Transformation Scheme for Near Optimal Surrogate Construction

Recent developments in surrogate construction predominantly focused on t...

Please sign up or login with your details

Forgot password? Click here to reset