Strudel: Learning Structured-Decomposable Probabilistic Circuits

07/18/2020
by   Meihua Dang, et al.
9

Probabilistic circuits (PCs) represent a probability distribution as a computational graph. Enforcing structural properties on these graphs guarantees that several inference scenarios become tractable. Among these properties, structured decomposability is a particularly appealing one: it enables the efficient and exact computations of the probability of complex logical formulas, and can be used to reason about the expected output of certain predictive models under missing data. This paper proposes Strudel, a simple, fast and accurate learning algorithm for structured-decomposable PCs. Compared to prior work for learning structured-decomposable PCs, Strudel delivers more accurate single PC models in fewer iterations, and dramatically scales learning when building ensembles of PCs. It achieves this scalability by exploiting another structural property of PCs, called determinism, and by sharing the same computational graph across mixture components. We show these advantages on standard density estimation benchmarks and challenging inference scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/04/2021

Tractable Regularization of Probabilistic Circuits

Probabilistic Circuits (PCs) are a promising avenue for probabilistic mo...
02/17/2022

Efficient and Reliable Probabilistic Interactive Learning with Structured Outputs

In this position paper, we study interactive learning for structured out...
02/11/2021

A Compositional Atlas of Tractable Circuit Operations: From Simple Transformations to Complex Information-Theoretic Queries

Circuit representations are becoming the lingua franca to express and re...
11/26/2021

Enforcing and Discovering Structure in Machine Learning

The world is structured in countless ways. It may be prudent to enforce ...
10/05/2019

On Tractable Computation of Expected Predictions

Computing expected predictions has many interesting applications in area...
12/02/2021

HyperSPNs: Compact and Expressive Probabilistic Circuits

Probabilistic circuits (PCs) are a family of generative models which all...
04/13/2020

Einsum Networks: Fast and Scalable Learning of Tractable Probabilistic Circuits

Probabilistic circuits (PCs) are a promising avenue for probabilistic mo...