Marginalization in Bayesian Networks: Integrating Exact and Approximate Inference

12/16/2021
by   Fritz M. Bayer, et al.
1

Bayesian Networks are probabilistic graphical models that can compactly represent dependencies among random variables. Missing data and hidden variables require calculating the marginal probability distribution of a subset of the variables. While knowledge of the marginal probability distribution is crucial for various problems in statistics and machine learning, its exact computation is generally not feasible for categorical variables due to the NP-hardness of this task. We develop a divide-and-conquer approach using the graphical properties of Bayesian networks to split the computation of the marginal probability distribution into sub-calculations of lower dimensionality, reducing the overall computational complexity. Exploiting this property, we present an efficient and scalable algorithm for estimating the marginal probability distribution for categorical variables. The novel method is compared against state-of-the-art approximate inference methods in a benchmarking study, where it displays superior performance. As an immediate application, we demonstrate how the marginal probability distribution can be used to classify incomplete data against Bayesian networks and use this approach for identifying the cancer subtype of kidney cancer patient samples.

READ FULL TEXT
research
12/23/2018

Inference in Graded Bayesian Networks

Machine learning provides algorithms that can learn from data and make i...
research
08/20/2018

A Distribution Similarity Based Regularizer for Learning Bayesian Networks

Probabilistic graphical models compactly represent joint distributions b...
research
01/10/2013

Hypothesis Management in Situation-Specific Network Construction

This paper considers the problem of knowledge-based model construction i...
research
11/09/2022

Utilising Bayesian Networks to combine multimodal data and expert opinion for the robust prediction of depression and its symptoms

Predicting the presence of major depressive disorder (MDD) using behavio...
research
01/23/2013

Mixture Approximations to Bayesian Networks

Structure and parameters in a Bayesian network uniquely specify the prob...
research
02/13/2013

Computational Complexity Reduction for BN2O Networks Using Similarity of States

Although probabilistic inference in a general Bayesian belief network is...
research
07/11/2012

Monotonicity in Bayesian Networks

For many real-life Bayesian networks, common knowledge dictates that the...

Please sign up or login with your details

Forgot password? Click here to reset