Batch Selection for Parallelisation of Bayesian Quadrature

12/04/2018
by   Ed Wagstaff, et al.
0

Integration over non-negative integrands is a central problem in machine learning (e.g. for model averaging, (hyper-)parameter marginalisation, and computing posterior predictive distributions). Bayesian Quadrature is a probabilistic numerical integration technique that performs promisingly when compared to traditional Markov Chain Monte Carlo methods. However, in contrast to easily-parallelised MCMC methods, Bayesian Quadrature methods have, thus far, been essentially serial in nature, selecting a single point to sample at each step of the algorithm. We deliver methods to select batches of points at each step, based upon those recently presented in the Batch Bayesian Optimisation literature. Such parallelisation significantly reduces computation time, especially when the integrand is expensive to sample.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/03/2014

Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature

We propose a novel sampling framework for inference in probabilistic mod...
research
05/09/2019

Stein Point Markov Chain Monte Carlo

An important task in machine learning and statistics is the approximatio...
research
10/08/2020

MatDRAM: A pure-MATLAB Delayed-Rejection Adaptive Metropolis-Hastings Markov Chain Monte Carlo Sampler

Markov Chain Monte Carlo (MCMC) algorithms are widely used for stochasti...
research
12/01/2010

A Bayesian Methodology for Estimating Uncertainty of Decisions in Safety-Critical Systems

Uncertainty of decisions in safety-critical engineering applications can...
research
11/29/2022

Bayesian Experimental Design for Symbolic Discovery

This study concerns the formulation and application of Bayesian optimal ...
research
08/30/2023

Sequential Bayesian Predictive Synthesis

Dynamic Bayesian predictive synthesis is a formal approach to coherently...
research
05/24/2019

Convergence Guarantees for Adaptive Bayesian Quadrature Methods

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical i...

Please sign up or login with your details

Forgot password? Click here to reset