Credal Networks under Maximum Entropy

01/16/2013
by   Thomas Lukasiewicz, et al.
0

We apply the principle of maximum entropy to select a unique joint probability distribution from the set of all joint probability distributions specified by a credal network. In detail, we start by showing that the unique joint distribution of a Bayesian tree coincides with the maximum entropy model of its conditional distributions. This result, however, does not hold anymore for general Bayesian networks. We thus present a new kind of maximum entropy models, which are computed sequentially. We then show that for all general Bayesian networks, the sequential maximum entropy model coincides with the unique joint distribution. Moreover, we apply the new principle of sequential maximum entropy to interval Bayesian networks and more generally to credal networks. We especially show that this application is equivalent to a number of small local entropy maximizations.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 8

research
08/02/2017

Dirichlet Bayesian Network Scores and the Maximum Entropy Principle

A classic approach for learning Bayesian networks from data is to select...
research
04/22/2018

Maximum entropy priors with derived parameters in a specified distribution

We propose a method for transforming probability distributions so that p...
research
03/13/2013

MESA: Maximum Entropy by Simulated Annealing

Probabilistic reasoning systems combine different probabilistic rules an...
research
08/30/2018

Maximum Entropy Principle Analysis in Network Systems with Short-time Recordings

In many realistic systems, maximum entropy principle (MEP) analysis prov...
research
08/20/2018

A Distribution Similarity Based Regularizer for Learning Bayesian Networks

Probabilistic graphical models compactly represent joint distributions b...
research
07/03/2022

Low probability states, data statistics, and entropy estimation

A fundamental problem in analysis of complex systems is getting a reliab...
research
03/13/2013

Entropy and Belief Networks

The product expansion of conditional probabilities for belief nets is no...

Please sign up or login with your details

Forgot password? Click here to reset