Tempering by Subsampling

01/28/2014
by   Jan-Willem van de Meent, et al.
0

In this paper we demonstrate that tempering Markov chain Monte Carlo samplers for Bayesian models by recursively subsampling observations without replacement can improve the performance of baseline samplers in terms of effective sample size per computation. We present two tempering by subsampling algorithms, subsampled parallel tempering and subsampled tempered transitions. We provide an asymptotic analysis of the computational cost of tempering by subsampling, verify that tempering by subsampling costs less than traditional tempering, and demonstrate both algorithms on Bayesian approaches to learning the mean of a high dimensional multivariate Normal and estimating Gaussian process hyperparameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2021

Ensemble Markov chain Monte Carlo with teleporting walkers

We introduce an ensemble Markov chain Monte Carlo approach to sampling f...
research
06/03/2015

Parallel Stochastic Gradient Markov Chain Monte Carlo for Matrix Factorisation Models

For large matrix factorisation problems, we develop a distributed Markov...
research
11/21/2016

Measuring Sample Quality with Diffusions

Standard Markov chain Monte Carlo diagnostics, like effective sample siz...
research
05/28/2020

Bayesian Restoration of Audio Degraded by Low-Frequency Pulses Modeled via Gaussian Process

A common defect found when reproducing old vinyl and gramophone recordin...
research
05/20/2018

Bayesian Modeling and Computation for Analyte Quantification in Complex Mixtures Using Raman Spectroscopy

In this work, we propose a two-stage algorithm based on Bayesian modelin...
research
05/10/2021

Warped Gradient-Enhanced Gaussian Process Surrogate Models for Inference with Intractable Likelihoods

Markov chain Monte Carlo methods for intractable likelihoods, such as th...
research
07/12/2019

Estimating densities with nonlinear support using Fisher-Gaussian kernels

Current tools for multivariate density estimation struggle when the dens...

Please sign up or login with your details

Forgot password? Click here to reset