Online Structure Learning for Sum-Product Networks with Gaussian Leaves

01/19/2017
by   Wilson Hsu, et al.
0

Sum-product networks have recently emerged as an attractive representation due to their dual view as a special type of deep neural network with clear semantics and a special type of probabilistic graphical model for which inference is always tractable. Those properties follow from some conditions (i.e., completeness and decomposability) that must be respected by the structure of the network. As a result, it is not easy to specify a valid sum-product network by hand and therefore structure learning techniques are typically used in practice. This paper describes the first online structure learning technique for continuous SPNs with Gaussian leaves. We also introduce an accompanying new parameter learning technique.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2021

Exchangeability-Aware Sum-Product Networks

Sum-Product Networks (SPNs) are expressive probabilistic models that pro...
research
05/26/2019

Bayesian Learning of Sum-Product Networks

Sum-product networks (SPNs) are flexible density estimators and have rec...
research
11/09/2018

Deep Compression of Sum-Product Networks on Tensor Networks

Sum-product networks (SPNs) represent an emerging class of neural networ...
research
05/04/2020

Sum-Product-Transform Networks: Exploiting Symmetries using Invertible Transformations

In this work, we propose Sum-Product-Transform Networks (SPTN), an exten...
research
08/08/2019

Random Sum-Product Forests with Residual Links

Tractable yet expressive density estimators are a key building block of ...
research
05/17/2023

Tractable Probabilistic Graph Representation Learning with Graph-Induced Sum-Product Networks

We introduce Graph-Induced Sum-Product Networks (GSPNs), a new probabili...
research
05/20/2019

Optimisation of Overparametrized Sum-Product Networks

It seems to be a pearl of conventional wisdom that parameter learning in...

Please sign up or login with your details

Forgot password? Click here to reset