SwISS: A Scalable Markov chain Monte Carlo Divide-and-Conquer Strategy

08/08/2022
by   Callum Vyner, et al.
0

Divide-and-conquer strategies for Monte Carlo algorithms are an increasingly popular approach to making Bayesian inference scalable to large data sets. In its simplest form, the data are partitioned across multiple computing cores and a separate Markov chain Monte Carlo algorithm on each core targets the associated partial posterior distribution, which we refer to as a sub-posterior, that is the posterior given only the data from the segment of the partition associated with that core. Divide-and-conquer techniques reduce computational, memory and disk bottle-necks, but make it difficult to recombine the sub-posterior samples. We propose SwISS: Sub-posteriors with Inflation, Scaling and Shifting; a new approach for recombining the sub-posterior samples which is simple to apply, scales to high-dimensional parameter spaces and accurately approximates the original posterior distribution through affine transformations of the sub-posterior samples. We prove that our transformation is asymptotically optimal across a natural set of affine transformations and illustrate the efficacy of SwISS against competing algorithms on synthetic and real-world data sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2021

Lagged couplings diagnose Markov chain Monte Carlo phylogenetic inference

Phylogenetic inference is an intractable statistical problem on a comple...
research
05/27/2019

Efficient posterior sampling for high-dimensional imbalanced logistic regression

High-dimensional data are routinely collected in many application areas....
research
12/24/2018

Bayesian Point Set Registration

Point set registration involves identifying a smooth invertible transfor...
research
09/21/2022

Single chain differential evolution Monte-Carlo for self-tuning Bayesian inference

1. Bayesian inference is difficult because it often requires time consum...
research
01/14/2015

Unbiased Bayes for Big Data: Paths of Partial Posteriors

A key quantity of interest in Bayesian inference are expectations of fun...
research
11/29/2022

Approximating Intersections and Differences Between Statistical Shape Models

To date, the comparison of Statistical Shape Models (SSMs) is often sole...
research
06/24/2022

A Phylogenetic Model of the Evolution of Discrete Matrices for the Joint Inference of Lexical and Phonological Language Histories

We propose a model of the evolution of a matrix along a phylogenetic tre...

Please sign up or login with your details

Forgot password? Click here to reset