Probabilistic Dependency Graphs

12/19/2020
by   Oliver Richardson, et al.
17

We introduce Probabilistic Dependency Graphs (PDGs), a new class of directed graphical models. PDGs can capture inconsistent beliefs in a natural way and are more modular than Bayesian Networks (BNs), in that they make it easier to incorporate new information and restructure the representation. We show by example how PDGs are an especially natural modeling tool. We provide three semantics for PDGs, each of which can be derived from a scoring function (on joint distributions over the variables in the network) that can be viewed as representing a distribution's incompatibility with the PDG. For the PDG corresponding to a BN, this function is uniquely minimized by the distribution the BN represents, showing that PDG semantics extend BN semantics. We show further that factor graphs and their exponential families can also be faithfully represented as PDGs, while there are significant barriers to modeling a PDG with a factor graph.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2013

Graphical Models and Exponential Families

We provide a classification of graphical models according to their repre...
research
10/19/2012

Extending Factor Graphs so as to Unify Directed and Undirected Graphical Models

The two most popular types of graphical model are directed models (Bayes...
research
07/11/2012

Convolutional Factor Graphs as Probabilistic Models

Based on a recent development in the area of error control coding, we in...
research
03/06/2013

Causal Modeling

Causal Models are like Dependency Graphs and Belief Nets in that they pr...
research
01/20/2023

On the Foundations of Cycles in Bayesian Networks

Bayesian networks (BNs) are a probabilistic graphical model widely used ...
research
02/24/2022

Loss as the Inconsistency of a Probabilistic Dependency Graph: Choose Your Model, Not Your Loss Function

In a world blessed with a great diversity of loss functions, we argue th...
research
09/29/2015

Semantics, Representations and Grammars for Deep Learning

Deep learning is currently the subject of intensive study. However, fund...

Please sign up or login with your details

Forgot password? Click here to reset