Rare Event Simulation for Steady-State Probabilities via Recurrency Cycles

04/05/2019
by   Krzysztof Bisewski, et al.
0

We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space R^d and discrete time steps (i.e. a discrete-time R^d-valued Markov chain). The algorithm, which we coin Recurrent Multilevel Splitting (RMS), relies on the Markov chain's underlying recurrent structure, in combination with the Multilevel Splitting method. Extensive simulation experiments are performed, including experiments with a nonlinear stochastic model that has some characteristics of complex climate models. The numerical experiments show that RMS can boost the computational efficiency by several orders of magnitude compared to the Monte Carlo method.

READ FULL TEXT
research
02/24/2021

The Cover Time of a (Multiple) Markov Chain with Rational Transition Probabilities is Rational

The cover time of a Markov chain on a finite state space is the expected...
research
08/28/2019

A Universal Splitting Estimator for the Performance Evaluation of Wireless Communications Systems

We propose a unified rare-event estimator for the performance evaluation...
research
11/27/2020

A splitting method to reduce MCMC variance

We explore whether splitting and killing methods can improve the accurac...
research
12/28/2021

A Near-Optimal Finite Approximation Approach for Computing Stationary Distribution and Performance Measures of Continuous-State Markov Chains

Analysis and use of stochastic models represented by a discrete-time Mar...
research
10/26/2022

Accelerated Weight Histogram Method for Rare Event Simulations

We describe an adaptive Markov chain Monte Carlo method suitable for the...
research
12/18/2022

A convergent numerical algorithm for the stochastic growth-fragmentation problem

The stochastic growth-fragmentation model describes the temporal evoluti...
research
11/15/2018

On a new class of score functions to estimate tail probabilities of some stochastic processes with Adaptive Multilevel Splitting

We investigate the application of the Adaptive Multilevel Splitting algo...

Please sign up or login with your details

Forgot password? Click here to reset