Probabilistic Deep Learning with Probabilistic Neural Networks and Deep Probabilistic Models

05/31/2021
by   Daniel T Chang, et al.
0

Probabilistic deep learning is deep learning that accounts for uncertainty, both model uncertainty and data uncertainty. It is based on the use of probabilistic models and deep neural networks. We distinguish two approaches to probabilistic deep learning: probabilistic neural networks and deep probabilistic models. The former employs deep neural networks that utilize probabilistic layers which can represent and process uncertainty; the latter uses probabilistic models that incorporate deep neural network components which capture complex non-linear stochastic relationships between the random variables. We discuss some major examples of each approach including Bayesian neural networks and mixture density networks (for probabilistic neural networks), and variational autoencoders, deep Gaussian processes and deep mixed effects models (for deep probabilistic models). TensorFlow Probability is a library for probabilistic modeling and inference which can be used for both approaches of probabilistic deep learning. We include its code examples for illustration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2021

Bayesian Neural Networks: Essentials

Bayesian neural networks utilize probabilistic layers that capture uncer...
research
08/09/2019

Probabilistic Models with Deep Neural Networks

Recent advances in statistical inference have significantly expanded the...
research
08/29/2019

InferPy: Probabilistic Modeling with Deep Neural Networks Made Easy

InferPy is a Python package for probabilistic modeling with deep neural ...
research
07/19/2021

Epistemic Neural Networks

We introduce the epistemic neural network (ENN) as an interface for unce...
research
09/16/2020

Neuro-symbolic Neurodegenerative Disease Modeling as Probabilistic Programmed Deep Kernels

We present a probabilistic programmed deep kernel learning approach to p...
research
06/05/2018

Probabilistic Deep Learning using Random Sum-Product Networks

Probabilistic deep learning currently receives an increased interest, as...
research
05/15/2017

Learning Probabilistic Programs Using Backpropagation

Probabilistic modeling enables combining domain knowledge with learning ...

Please sign up or login with your details

Forgot password? Click here to reset