Sufficiency, Separability and Temporal Probabilistic Models

by   Avi Pfeffer, et al.

Suppose we are given the conditional probability of one variable given some other variables.Normally the full joint distribution over the conditioning variablesis required to determine the probability of the conditioned variable.Under what circumstances are the marginal distributions over the conditioning variables sufficient to determine the probability ofthe conditioned variable?Sufficiency in this sense is equivalent to additive separability ofthe conditional probability distribution.Such separability structure is natural and can be exploited forefficient inference.Separability has a natural generalization to conditional separability.Separability provides a precise notion of weaklyinteracting subsystems in temporal probabilistic models.Given a system that is decomposed into separable subsystems, exactmarginal probabilities over subsystems at future points in time can becomputed by propagating marginal subsystem probabilities, rather thancomplete system joint probabilities.Thus, separability can make exact prediction tractable.However, observations can break separability,so exact monitoring of dynamic systems remains hard.


page 1

page 2

page 3

page 8


Probabilistic Programs with Stochastic Conditioning

We tackle the problem of conditioning probabilistic programs on distribu...

Relations among conditional probabilities

We describe a Groebner basis of relations among conditional probabilitie...

Using Eigencentrality to Estimate Joint, Conditional and Marginal Probabilities from Mixed-Variable Data: Method and Applications

The ability to estimate joint, conditional and marginal probability dist...

Decorated Linear Relations: Extending Gaussian Probability with Uninformative Priors

We introduce extended Gaussian distributions as a precise and principled...

A Probabilistic Calculus of Actions

We present a symbolic machinery that admits both probabilistic and causa...

Computing Probability Intervals Under Independency Constraints

Many AI researchers argue that probability theory is only capable of dea...

MESA: Maximum Entropy by Simulated Annealing

Probabilistic reasoning systems combine different probabilistic rules an...