Towards Bayesian Deep Learning: A Survey

by   Hao Wang, et al.

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence. The past few years have seen major advances in many perception tasks using deep learning models. For higher-level inference, however, probabilistic graphical models with their Bayesian nature are still more powerful and flexible. To achieve integrated intelligence that involves both perception and inference, it is naturally desirable to tightly integrate deep learning and Bayesian models within a principled probabilistic framework, which we call Bayesian deep learning. In this unified framework, the perception of text or images using deep learning can boost the performance of higher-level inference and in return, the feedback from the inference process is able to enhance the perception of text or images. This survey provides a general introduction to Bayesian deep learning and reviews its recent applications on recommender systems, topic models, and control. In this survey, we also discuss the relationship and differences between Bayesian deep learning and other related topics like Bayesian treatment of neural networks.


page 1

page 2

page 3

page 4


Towards Bayesian Deep Learning: A Framework and Some Existing Methods

While perception tasks such as visual object recognition and text unders...

Tutorial and Survey on Probabilistic Graphical Model and Variational Inference in Deep Reinforcement Learning

Probabilistic Graphical Modeling and Variational Inference play an impor...

Visual Sensation and Perception Computational Models for Deep Learning: State of the art, Challenges and Prospects

Visual sensation and perception refers to the process of sensing, organi...

A Probabilistic Theory of Deep Learning

A grand challenge in machine learning is the development of computationa...

Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why not

Deep-learning has dramatically changed the world overnight. It greatly b...

Bayesian Learning for Neural Networks: an algorithmic survey

The last decade witnessed a growing interest in Bayesian learning. Yet, ...

A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decision

Deep learning has the potential to revolutionize sports performance, wit...

Please sign up or login with your details

Forgot password? Click here to reset