Bayesian Neural Networks

by   Vikram Mullachery, et al.

This paper describes and discusses Bayesian Neural Network (BNN). The paper showcases a few different applications of them for classification and regression problems. BNNs are comprised of a Probabilistic Model and a Neural Network. The intent of such a design is to combine the strengths of Neural Networks and Stochastic modeling. Neural Networks exhibit continuous function approximator capabilities. Stochastic models allow direct specification of a model with known interaction between parameters to generate data. During the prediction phase, stochastic models generate a complete posterior distribution and produce probabilistic guarantees on the predictions. Thus BNNs are a unique combination of neural network and stochastic models with the stochastic model forming the core of this integration. BNNs can then produce probabilistic guarantees on it's predictions and also generate the distribution of parameters that it has learnt from the observations. That means, in the parameter space, one can deduce the nature and shape of the neural network's learnt parameters. These two characteristics makes them highly attractive to theoreticians as well as practitioners. Recently there has been a lot of activity in this area, with the advent of numerous probabilistic programming libraries such as: PyMC3, Edward, Stan etc. Further this area is rapidly gaining ground as a standard machine learning approach for numerous problems



There are no comments yet.


page 12

page 14


Bayesian Learning of Neural Network Architectures

In this paper we propose a Bayesian method for estimating architectural ...

The Future of Neural Networks

The paper describes some recent developments in neural networks and disc...

Improving Uncertainty Calibration via Prior Augmented Data

Neural networks have proven successful at learning from complex data dis...

Exploiting Oxide Based Resistive RAM Variability for Bayesian Neural Network Hardware Design

Uncertainty plays a key role in real-time machine learning. As a signifi...

Practical Bayesian Learning of Neural Networks via Adaptive Subgradient Methods

We introduce a novel framework for the estimation of the posterior distr...

Estimating uncertainty of earthquake rupture using Bayesian neural network

Bayesian neural networks (BNN) are the probabilistic model that combines...

Code Repositories


Variational Information Maximizing Exploration (VIME) as presented in "Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural Networks"

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.