A Piecewise Deterministic Markov Process via (r,θ) swaps in hyperspherical coordinates

07/02/2018
by   Alexander Terenin, et al.
0

Recently, a class of stochastic processes known as piecewise deterministic Markov processes has been used to define continuous-time Markov chain Monte Carlo algorithms with a number of attractive properties, including compatibility with stochastic gradients like those typically found in optimization and variational inference, and high efficiency on certain big data problems. Not many processes in this class that are capable of targeting arbitrary invariant distributions are currently known, and within one subclass all previously known processes utilize linear transition functions. In this work, we derive a process whose transition function is nonlinear through solving its Fokker-Planck equation in hyperspherical coordinates. We explore its behavior on Gaussian targets, as well as a Bayesian logistic regression model with synthetic data. We discuss implications to both the theory of piecewise deterministic Markov processes, and to Bayesian statisticians as well as physicists seeking to use them for simulation-based computation.

READ FULL TEXT

page 7

page 8

research
10/20/2019

Cores for Piecewise-Deterministic Markov Processes used in Markov Chain Monte Carlo

This article provides a tool for the analysis of Piecewise-deterministic...
research
02/10/2018

Modeling Dynamics with Deep Transition-Learning Networks

Markov processes, both classical and higher order, are often used to mod...
research
11/10/2021

PDMP Monte Carlo methods for piecewise-smooth densities

There has been substantial interest in developing Markov chain Monte Car...
research
10/25/2022

Federated Bayesian Computation via Piecewise Deterministic Markov Processes

When performing Bayesian computations in practice, one is often faced wi...
research
09/24/2021

Approximations of Piecewise Deterministic Markov Processes and their convergence properties

Piecewise deterministic Markov processes (PDMPs) are a class of stochast...
research
11/24/2021

Strong Invariance Principles for Ergodic Markov Processes

Strong invariance principles describe the error term of a Brownian appro...
research
03/15/2021

Sticky PDMP samplers for sparse and local inference problems

We construct a new class of efficient Monte Carlo methods based on conti...

Please sign up or login with your details

Forgot password? Click here to reset