Recognition Networks for Approximate Inference in BN20 Networks

by   Quaid Morris, et al.

We propose using recognition networks for approximate inference inBayesian networks (BNs). A recognition network is a multilayerperception (MLP) trained to predict posterior marginals given observedevidence in a particular BN. The input to the MLP is a vector of thestates of the evidential nodes. The activity of an output unit isinterpreted as a prediction of the posterior marginal of thecorresponding variable. The MLP is trained using samples generated fromthe corresponding BN.We evaluate a recognition network that was trained to do inference ina large Bayesian network, similar in structure and complexity to theQuick Medical Reference, Decision Theoretic (QMR-DT). Our networkis a binary, two-layer, noisy-OR network containing over 4000 potentially observable nodes and over 600 unobservable, hidden nodes. Inreal medical diagnosis, most observables are unavailable, and there isa complex and unknown bias that selects which ones are provided. Weincorporate a very basic type of selection bias in our network: a knownpreference that available observables are positive rather than negative.Even this simple bias has a significant effect on the posterior. We compare the performance of our recognition network tostate-of-the-art approximate inference algorithms on a large set oftest cases. In order to evaluate the effect of our simplistic modelof the selection bias, we evaluate algorithms using a variety ofincorrectly modeled observation biases. Recognition networks performwell using both correct and incorrect observation biases.



There are no comments yet.


page 1

page 2

page 3

page 4


Tractable Approximate Gaussian Inference for Bayesian Neural Networks

In this paper, we propose an analytical method allowing for tractable ap...

Parametric generation of conditional geological realizations using generative neural networks

We introduce a method for parametric generation of conditional geologica...

Sampling Bias Correction for Supervised Machine Learning: A Bayesian Inference Approach with Practical Applications

Given a supervised machine learning problem where the training set has b...

Intrinsic Bias Identification on Medical Image Datasets

Machine learning based medical image analysis highly depends on datasets...

A Universal Marginalizer for Amortized Inference in Generative Models

We consider the problem of inference in a causal generative model where ...

Iterative Refinement of Approximate Posterior for Training Directed Belief Networks

Variational methods that rely on a recognition network to approximate th...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.