DeepAI AI Chat
Log In Sign Up

Decayed MCMC Filtering

12/12/2012
by   Bhaskara Marthi, et al.
0

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior distribution is generally intractable for large discrete systems and for nonlinear continuous systems, so a good deal of effort has gone into developing robust approximation algorithms. This paper describes a simple stochastic approximation algorithm for filtering called em decayed MCMC. The algorithm applies Markov chain Monte Carlo sampling to the space of state trajectories using a proposal distribution that favours flips of more recent state variables. The formal analysis of the algorithm involves a generalization of standard coupling arguments for MCMC convergence. We prove that for any ergodic underlying Markov process, the convergence time of decayed MCMC with inverse-polynomial decay remains bounded as the length of the observation sequence grows. We show experimentally that decayed MCMC is at least competitive with other approximation algorithms such as particle filtering.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 8

02/11/2022

Long-Time Convergence and Propagation of Chaos for Nonlinear MCMC

In this paper, we study the long-time convergence and uniform strong pro...
11/29/2020

Accelerating MCMC algorithms through Bayesian Deep Networks

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their v...
12/06/2020

FPRAS Approximation of the Matrix Permanent in Practice

The matrix permanent belongs to the complexity class #P-Complete. It is ...
03/01/2023

Auxiliary MCMC and particle Gibbs samplers for parallelisable inference in latent dynamical systems

We introduce two new classes of exact Markov chain Monte Carlo (MCMC) sa...
05/29/2020

Rate-optimal refinement strategies for local approximation MCMC

Many Bayesian inference problems involve target distributions whose dens...
05/23/2019

Efficient MCMC Sampling with Dimension-Free Convergence Rate using ADMM-type Splitting

Performing exact Bayesian inference for complex models is intractable. M...
09/05/2020

Uncertainty modelling and computational aspects of data association

A novel solution to the smoothing problem for multi-object dynamical sys...