Symbolic Exact Inference for Discrete Probabilistic Programs

04/03/2019
by   Steven Holtzen, et al.
0

The computational burden of probabilistic inference remains a hurdle for applying probabilistic programming languages to practical problems of interest. In this work, we provide a semantic and algorithmic foundation for efficient exact inference on discrete-valued finite-domain imperative probabilistic programs. We leverage and generalize efficient inference procedures for Bayesian networks, which exploit the structure of the network to decompose the inference task, thereby avoiding full path enumeration. To do this, we first compile probabilistic programs to a symbolic representation. Then we adapt techniques from the probabilistic logic programming and artificial intelligence communities in order to perform inference on the symbolic representation. We formalize our approach, prove it sound, and experimentally validate it against existing exact and approximate inference techniques. We show that our inference approach is competitive with inference procedures specialized for Bayesian networks, thereby expanding the class of probabilistic programs which can be practically analyzed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/18/2020

Scaling Exact Inference for Discrete Probabilistic Programs

Probabilistic programming languages (PPLs) are an expressive means of re...
research
09/15/2022

Semi-Symbolic Inference for Efficient Streaming Probabilistic Programming

Efficient inference is often possible in a streaming context using Rao-B...
research
04/26/2018

Constraint-Based Inference in Probabilistic Logic Programs

Probabilistic Logic Programs (PLPs) generalize traditional logic program...
research
10/07/2020

SPPL: Probabilistic Programming with Fast Exact Symbolic Inference

We present the Sum-Product Probabilistic Language (SPPL), a new probabil...
research
07/14/2023

Verifying Performance Properties of Probabilistic Inference

In this extended abstract, we discuss the opportunity to formally verify...
research
05/15/2017

Constrained Bayesian Networks: Theory, Optimization, and Applications

We develop the theory and practice of an approach to modelling and proba...
research
07/25/2023

Scaling Integer Arithmetic in Probabilistic Programs

Distributions on integers are ubiquitous in probabilistic modeling but r...

Please sign up or login with your details

Forgot password? Click here to reset