Parallel sampling of decomposable graphs using Markov chain on junction trees

09/05/2022
by   Mohamad Elmasri, et al.
0

Bayesian inference for undirected graphical models is mostly restricted to the class of decomposable graphs, as they enjoy a rich set of properties making them amenable to high-dimensional problems. While parameter inference is straightforward in this setup, inferring the underlying graph is a challenge driven by the computational difficultly in exploring the space of decomposable graphs. This work makes two contributions to address this problem. First, we provide sufficient and necessary conditions for when multi-edge perturbations maintain decomposability of the graph. Using these, we characterize a simple class of partitions that efficiently classify all edge perturbations by whether they maintain decomposability. Second, we propose a new parallel non-reversible Markov chain Monte Carlo sampler for distributions over junction tree representations of the graph, where at every step, all edge perturbations within a partition are executed simultaneously. Through simulations, we demonstrate the efficiency of our new edge perturbation conditions and class of partitions. We find that our parallel sampler yields improved mixing properties in comparison to the single-move variate, and outperforms current methods. The implementation of our work is available in a Python package.

READ FULL TEXT
research
03/09/2017

Parallel Markov Chain Monte Carlo for the Indian Buffet Process

Indian Buffet Process based models are an elegant way for discovering un...
research
12/04/2017

Sub-clustering in decomposable graphs and size-varying junction trees

This paper proposes a novel representation of decomposable graphs based ...
research
11/14/2018

Randomisation Algorithms for Large Sparse Matrices

In many domains it is necessary to generate surrogate networks, e.g., fo...
research
05/09/2022

On a wider class of prior distributions for graphical models

Gaussian graphical models are useful tools for conditional independence ...
research
09/20/2019

Inference for the stochastic block model with unknown number of blocks and non-conjugate edge models

The stochastic block model (SBM) is a popular model for capturing commun...
research
10/23/2019

Automatically Batching Control-Intensive Programs for Modern Accelerators

We present a general approach to batching arbitrary computations for acc...
research
04/10/2015

A closed-form approach to Bayesian inference in tree-structured graphical models

We consider the inference of the structure of an undirected graphical mo...

Please sign up or login with your details

Forgot password? Click here to reset