On the Validity of Bayesian Neural Networks for Uncertainty Estimation

12/03/2019
by   John Mitros, et al.
0

Deep neural networks (DNN) are versatile parametric models utilised successfully in a diverse number of tasks and domains. However, they have limitations—particularly from their lack of robustness and over-sensitivity to out of distribution samples. Bayesian Neural Networks, due to their formulation under the Bayesian framework, provide a principled approach to building neural networks that address these limitations. This paper describes a study that empirically evaluates and compares Bayesian Neural Networks to their equivalent point estimate Deep Neural Networks to quantify the predictive uncertainty induced by their parameters, as well as their performance in view of this uncertainty. In this study, we evaluated and compared three point estimate deep neural networks against comparable Bayesian neural network alternatives using two well-known benchmark image classification datasets (CIFAR-10 and SVHN).

READ FULL TEXT
research
01/07/2022

Bayesian Neural Networks for Reversible Steganography

Recent advances in deep learning have led to a paradigm shift in reversi...
research
02/18/2018

Bayesian Uncertainty Estimation for Batch Normalized Deep Networks

Deep neural networks have led to a series of breakthroughs, dramatically...
research
03/21/2019

Empirical confidence estimates for classification by deep neural networks

How well can we estimate the probability that the classification, C(f(x)...
research
07/28/2020

Toward Reliable Models for Authenticating Multimedia Content: Detecting Resampling Artifacts With Bayesian Neural Networks

In multimedia forensics, learning-based methods provide state-of-the-art...
research
12/02/2019

Implicit Priors for Knowledge Sharing in Bayesian Neural Networks

Bayesian interpretations of neural network have a long history, dating b...
research
09/05/2023

Sparse Function-space Representation of Neural Networks

Deep neural networks (NNs) are known to lack uncertainty estimates and s...
research
03/20/2019

Performance Measurement for Deep Bayesian Neural Network

Deep Bayesian neural network has aroused a great attention in recent yea...

Please sign up or login with your details

Forgot password? Click here to reset