Uncertainty in Neural Networks: Bayesian Ensembling

10/12/2018
by   Tim Pearce, et al.
0

Understanding the uncertainty of a neural network's (NN) predictions is essential for many applications. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to the large number of parameters and data. Ensembling NNs provides a practical and scalable method for uncertainty quantification. Its drawback is that its justification is heuristic rather than Bayesian. In this work we propose one modification to the usual ensembling process, that does result in Bayesian behaviour: regularising parameters about values drawn from a prior distribution. Hence, we present an easily implementable, scalable technique for performing approximate Bayesian inference in NNs.

READ FULL TEXT
research
11/27/2018

Bayesian Neural Network Ensembles

Ensembles of neural networks (NNs) have long been used to estimate predi...
research
06/18/2021

Being a Bit Frequentist Improves Bayesian Neural Networks

Despite their compelling theoretical properties, Bayesian neural network...
research
05/29/2018

Bayesian Inference with Anchored Ensembles of Neural Networks, and Application to Reinforcement Learning

The use of ensembles of neural networks (NNs) for the quantification of ...
research
04/14/2021

ComBiNet: Compact Convolutional Bayesian Neural Network for Image Segmentation

Fully convolutional U-shaped neural networks have largely been the domin...
research
03/22/2023

Data-Driven Uncertainty Quantification of the Wave-Telescope Technique: General Equations and Application to HelioSwarm

The upcoming NASA mission HelioSwarm will use nine spacecraft to make th...
research
12/02/2016

Inferring Cognitive Models from Data using Approximate Bayesian Computation

An important problem for HCI researchers is to estimate the parameter va...
research
07/07/2022

Inferring Structural Parameters of Low-Surface-Brightness-Galaxies with Uncertainty Quantification using Bayesian Neural Networks

Measuring the structural parameters (size, total brightness, light conce...

Please sign up or login with your details

Forgot password? Click here to reset