Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields

09/06/2023
by   Lily Goli, et al.
0

Neural Radiance Fields (NeRFs) have shown promise in applications like view synthesis and depth estimation, but learning from multiview images faces inherent uncertainties. Current methods to quantify them are either heuristic or computationally demanding. We introduce BayesRays, a post-hoc framework to evaluate uncertainty in any pre-trained NeRF without modifying the training process. Our method establishes a volumetric uncertainty field using spatial perturbations and a Bayesian Laplace approximation. We derive our algorithm statistically and show its superior performance in key metrics and applications. Additional results available at: https://bayesrays.github.io.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
12/14/2022

Post-hoc Uncertainty Learning using a Dirichlet Meta-Model

It is known that neural networks have the problem of being over-confiden...
research
11/05/2021

Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning

Deep neural networks are prone to overconfident predictions on outliers....
research
10/06/2020

Learnable Uncertainty under Laplace Approximations

Laplace approximations are classic, computationally lightweight means fo...
research
09/05/2021

Stochastic Neural Radiance Fields:Quantifying Uncertainty in Implicit 3D Representations

Neural Radiance Fields (NeRF) has become a popular framework for learnin...
research
08/17/2023

Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression

Uncertainty quantification is critical for deploying deep neural network...
research
03/18/2022

Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantification

A critical limitation of current methods based on Neural Radiance Fields...
research
09/27/2021

Introspective Robot Perception using Smoothed Predictions from Bayesian Neural Networks

This work focuses on improving uncertainty estimation in the field of ob...

Please sign up or login with your details

Forgot password? Click here to reset