DeepAI AI Chat
Log In Sign Up

Prior choice affects ability of Bayesian neural networks to identify unknowns

05/11/2020
by   Daniele Silvestro, et al.
15

Deep Bayesian neural networks (BNNs) are a powerful tool, though computationally demanding, to perform parameter estimation while jointly estimating uncertainty around predictions. BNNs are typically implemented using arbitrary normal-distributed prior distributions on the model parameters. Here, we explore the effects of different prior distributions on classification tasks in BNNs and evaluate the evidence supporting the predictions based on posterior probabilities approximated by Markov Chain Monte Carlo sampling and by computing Bayes factors. We show that the choice of priors has a substantial impact on the ability of the model to confidently assign data to the correct class (true positive rates). Prior choice also affects significantly the ability of a BNN to identify out-of-distribution instances as unknown (false positive rates). When comparing our results against neural networks (NN) with Monte Carlo dropout we found that BNNs generally outperform NNs. Finally, in our tests we did not find a single best choice as prior distribution. Instead, each dataset yielded the best results under a different prior, indicating that testing alternative options can improve the performance of BNNs.

READ FULL TEXT

page 12

page 13

04/11/2005

Bayesian Restoration of Digital Images Employing Markov Chain Monte Carlo a Review

A review of Bayesian restoration of digital images based on Monte Carlo ...
04/08/2008

On the underestimation of model uncertainty by Bayesian K-nearest neighbors

When using the K-nearest neighbors method, one often ignores uncertainty...
11/25/2020

All You Need is a Good Functional Prior for Bayesian Deep Learning

The Bayesian treatment of neural networks dictates that a prior distribu...
02/06/2023

Prior Density Learning in Variational Bayesian Phylogenetic Parameters Inference

The advances in variational inference are providing promising paths in B...
12/21/2019

A Symmetric Prior for Multinomial Probit Models

Under standard prior distributions, fitted probabilities from Bayesian m...
05/14/2021

BNNpriors: A library for Bayesian neural network inference with different prior distributions

Bayesian neural networks have shown great promise in many applications w...

Code Repositories

npBNN

Bayesian neural networks using Numpy and Scipy


view repo