Towards Bayesian Deep Learning: A Framework and Some Existing Methods

08/24/2016
by   Hao Wang, et al.
0

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence. The past few years have seen major advances in many perception tasks using deep learning models. For higher-level inference, however, probabilistic graphical models with their Bayesian nature are still more powerful and flexible. To achieve integrated intelligence that involves both perception and inference, it is naturally desirable to tightly integrate deep learning and Bayesian models within a principled probabilistic framework, which we call Bayesian deep learning. In this unified framework, the perception of text or images using deep learning can boost the performance of higher-level inference and in return, the feedback from the inference process is able to enhance the perception of text or images. This paper proposes a general framework for Bayesian deep learning and reviews its recent applications on recommender systems, topic models, and control. In this paper, we also discuss the relationship and differences between Bayesian deep learning and other related topics like Bayesian treatment of neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2016

Towards Bayesian Deep Learning: A Survey

While perception tasks such as visual object recognition and text unders...
research
02/04/2018

Tunneling Neural Perception and Logic Reasoning through Abductive Learning

Perception and reasoning are basic human abilities that are seamlessly c...
research
09/18/2017

ZhuSuan: A Library for Bayesian Deep Learning

In this paper we introduce ZhuSuan, a python probabilistic programming l...
research
04/02/2015

A Probabilistic Theory of Deep Learning

A grand challenge in machine learning is the development of computationa...
research
11/13/2015

Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition

Rich semantic relations are important in a variety of visual recognition...
research
04/26/2022

Designing Perceptual Puzzles by Differentiating Probabilistic Programs

We design new visual illusions by finding "adversarial examples" for pri...
research
05/05/2015

In Defense of the Direct Perception of Affordances

The field of functional recognition or affordance estimation from images...

Please sign up or login with your details

Forgot password? Click here to reset