Smoothing Structured Decomposable Circuits

06/01/2019
by   Andy Shih, et al.
3

We study the task of smoothing a circuit, i.e., ensuring that all children of a plus-gate mention the same variables. Circuits serve as the building blocks of state-of-the-art inference algorithms on discrete probabilistic graphical models and probabilistic programs. They are also important for discrete density estimation algorithms. Many of these tasks require the input circuit to be smooth. However, smoothing has not been studied in its own right yet, and only a trivial quadratic algorithm is known. This paper studies efficient smoothing for structured decomposable circuits. We propose a near-linear time algorithm for this task and explore lower bounds for smoothing general circuits, using existing results on range-sum queries. Further, for the important special case of All-Marginals, we show a more efficient linear-time algorithm. We validate experimentally the performance of our methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2021

Tractable Regularization of Probabilistic Circuits

Probabilistic Circuits (PCs) are a promising avenue for probabilistic mo...
research
11/29/2021

Algorithms and Lower Bounds for Comparator Circuits from Shrinkage

Comparator circuits are a natural circuit model for studying bounded fan...
research
10/22/2020

Probabilistic Circuits for Variational Inference in Discrete Graphical Models

Inference in discrete graphical models with variational methods is diffi...
research
02/19/2021

Probabilistic Generating Circuits

Generating functions, which are widely used in combinatorics and probabi...
research
08/02/2018

Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits

Experimental observations of neuroscience suggest that the brain is work...
research
02/15/2017

Linear Time Computation of Moments in Sum-Product Networks

Bayesian online algorithms for Sum-Product Networks (SPNs) need to updat...

Please sign up or login with your details

Forgot password? Click here to reset