DeepAI AI Chat
Log In Sign Up

Entropy and Belief Networks

by   Norman C. Dalkey, et al.

The product expansion of conditional probabilities for belief nets is not maximum entropy. This appears to deny a desirable kind of assurance for the model. However, a kind of guarantee that is almost as strong as maximum entropy can be derived. Surprisingly, a variant model also exhibits the guarantee, and for many cases obtains a higher performance score than the product expansion.


page 1

page 2

page 3

page 4


Kutato: An Entropy-Driven System for Construction of Probabilistic Expert Systems from Databases

Kutato is a system that takes as input a database of cases and produces ...

Credal Networks under Maximum Entropy

We apply the principle of maximum entropy to select a unique joint proba...

From Sharma-Mittal to von-Neumann Entropy of a Graph

In this article, we introduce the Sharma-Mittal entropy of a graph, whic...

Ihara Zeta Entropy

In this article, we introduce an entropy based on the formal power serie...

Bayesian image segmentations by Potts prior and loopy belief propagation

This paper presents a Bayesian image segmentation model based on Potts p...

The Convexity and Concavity of Envelopes of the Minimum-Relative-Entropy Region for the DSBS

In this paper, we prove that for the doubly symmetric binary distributio...

Decisions with Limited Observations over a Finite Product Space: the Klir Effect

Probability estimation by maximum entropy reconstruction of an initial r...