Joint Probability Trees

02/14/2023
by   Daniel Nyga, et al.
0

We introduce Joint Probability Trees (JPT), a novel approach that makes learning of and reasoning about joint probability distributions tractable for practical applications. JPTs support both symbolic and subsymbolic variables in a single hybrid model, and they do not rely on prior knowledge about variable dependencies or families of distributions. JPT representations build on tree structures that partition the problem space into relevant subregions that are elicited from the training data instead of postulating a rigid dependency model prior to learning. Learning and reasoning scale linearly in JPTs, and the tree structure allows white-box reasoning about any posterior probability P(Q|E), such that interpretable explanations can be provided for any inference result. Our experiments showcase the practical applicability of JPTs in high-dimensional heterogeneous probability spaces with millions of training samples, making it a promising alternative to classic probabilistic graphical models.

READ FULL TEXT

page 6

page 12

page 14

page 16

research
01/22/2020

Joint Distributions for TensorFlow Probability

A central tenet of probabilistic programming is that a model is specifie...
research
04/21/2020

Rigorous Explanation of Inference on Probabilistic Graphical Models

Probabilistic graphical models, such as Markov random fields (MRF), expl...
research
12/17/2019

Learning high-dimensional probability distributions using tree tensor networks

We consider the problem of the estimation of a high-dimensional probabil...
research
04/21/2015

Reasoning about Unmodelled Concepts - Incorporating Class Taxonomies in Probabilistic Relational Models

A key problem in the application of first-order probabilistic methods is...
research
01/19/2012

On the Prior and Posterior Distributions Used in Graphical Modelling

Graphical model learning and inference are often performed using Bayesia...
research
07/30/2023

Using Staged Tree Models for Health Data: Investigating Invasive Fungal Infections by Aspergillus and Other Filamentous Fungi

Machine learning models are increasingly used in the medical domain to s...
research
11/21/2018

Information-Guided Temporal Logic Inference with Prior Knowledge

This paper investigates the problem of inferring knowledge from data so ...

Please sign up or login with your details

Forgot password? Click here to reset