Exact Inference in Networks with Discrete Children of Continuous Parents

by   Uri Lerner, et al.

Many real life domains contain a mixture of discrete and continuous variables and can be modeled as hybrid Bayesian Networks. Animportant subclass of hybrid BNs are conditional linear Gaussian (CLG) networks, where the conditional distribution of the continuous variables given an assignment to the discrete variables is a multivariate Gaussian. Lauritzen's extension to the clique tree algorithm can be used for exact inference in CLG networks. However, many domains also include discrete variables that depend on continuous ones, and CLG networks do not allow such dependencies to berepresented. No exact inference algorithm has been proposed for these enhanced CLG networks. In this paper, we generalize Lauritzen's algorithm, providing the first "exact" inference algorithm for augmented CLG networks - networks where continuous nodes are conditional linear Gaussians but that also allow discrete children ofcontinuous parents. Our algorithm is exact in the sense that it computes the exact distributions over the discrete nodes, and the exact first and second moments of the continuous ones, up to the accuracy obtained by numerical integration used within thealgorithm. When the discrete children are modeled with softmax CPDs (as is the case in many real world domains) the approximation of the continuous distributions using the first two moments is particularly accurate. Our algorithm is simple to implement and often comparable in its complexity to Lauritzen's algorithm. We show empirically that it achieves substantially higher accuracy than previous approximate algorithms.


page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 10


Hybrid Bayesian Networks with Linear Deterministic Variables

When a hybrid Bayesian network has conditionally deterministic variables...

Gaussian Mixture Reduction for Time-Constrained Approximate Inference in Hybrid Bayesian Networks

Hybrid Bayesian Networks (HBNs), which contain both discrete and continu...

Inference in Hybrid Networks: Theoretical Limits and Practical Algorithms

An important subclass of hybrid Bayesian networks are those that represe...

A Variational Approximation for Bayesian Networks with Discrete and Continuous Latent Variables

We show how to use a variational approximation to the logistic function ...

Lifted Inference for Relational Continuous Models

Relational Continuous Models (RCMs) represent joint probability densitie...

Region Based Approximation for High Dimensional Bayesian Network Models

Performing efficient inference on Bayesian Networks (BNs), with large nu...

Interpolating Conditional Density Trees

Joint distributions over many variables are frequently modeled by decomp...

Please sign up or login with your details

Forgot password? Click here to reset