Ensemble Rejection Sampling

01/24/2020
by   George Deligiannidis, et al.
0

We introduce Ensemble Rejection Sampling, a scheme for exact simulation from the posterior distribution of the latent states of a class of non-linear non-Gaussian state-space models. Ensemble Rejection Sampling relies on a proposal for the high-dimensional state sequence built using ensembles of state samples. Although this algorithm can be interpreted as a rejection sampling scheme acting on an extended space, we show under regularity conditions that the expected computational cost to obtain an exact sample increases cubically with the length of the state sequence instead of exponentially for standard rejection sampling. We demonstrate this methodology by sampling exactly state sequences according to the posterior distribution of a stochastic volatility model and a non-linear autoregressive process. We also present an application to rare event simulation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2022

An Analysis of Ensemble Sampling

Ensemble sampling serves as a practical approximation to Thompson sampli...
research
05/20/2017

Ensemble Sampling

Thompson sampling has emerged as an effective heuristic for a broad rang...
research
01/24/2018

Gaussian variational approximation for high-dimensional state space models

Our article considers variational approximations of the posterior distri...
research
10/13/2022

Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference

This paper presents a fast algorithm for estimating hidden states of Bay...
research
05/30/2017

Identification of Gaussian Process State Space Models

The Gaussian process state space model (GPSSM) is a non-linear dynamical...
research
03/14/2019

Stochastic Beams and Where to Find Them: The Gumbel-Top-k Trick for Sampling Sequences Without Replacement

The well-known Gumbel-Max trick for sampling from a categorical distribu...
research
11/19/2018

Informed MCMC with Bayesian Neural Networks for Facial Image Analysis

Computer vision tasks are difficult because of the large variability in ...

Please sign up or login with your details

Forgot password? Click here to reset