Factored Filtering of Continuous-Time Systems

02/14/2012
by   E. Busra Celikkaya, et al.
0

We consider filtering for a continuous-time, or asynchronous, stochastic system where the full distribution over states is too large to be stored or calculated. We assume that the rate matrix of the system can be compactly represented and that the belief distribution is to be approximated as a product of marginals. The essential computation is the matrix exponential. We look at two different methods for its computation: ODE integration and uniformization of the Taylor expansion. For both we consider approximations in which only a factored belief state is maintained. For factored uniformization we demonstrate that the KL-divergence of the filtering is bounded. Our experimental results confirm our factored uniformization performs better than previously suggested uniformization methods and the mean field algorithm.

READ FULL TEXT
research
06/01/2011

Mean Field Methods for a Special Class of Belief Networks

The chief aim of this paper is to propose mean-field approximations for ...
research
07/05/2020

Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications

In this paper, we deepen the analysis of continuous time Fictitious Play...
research
10/02/2020

POMDPs in Continuous Time and Discrete Spaces

Many processes, such as discrete event systems in engineering or populat...
research
12/24/2014

Concentration for matrix martingales in continuous time and microscopic activity of social networks

This paper gives new concentration inequalities for the spectral norm of...
research
01/30/2014

Exploiting Causality for Selective Belief Filtering in Dynamic Bayesian Networks

Dynamic Bayesian networks (DBNs) are a general model for stochastic proc...
research
07/10/2019

Exploiting Causality for Selective Belief Filtering in Dynamic Bayesian Networks (Extended Abstract)

Dynamic Bayesian networks (DBNs) are a general model for stochastic proc...
research
01/11/2021

Pathwise approximations for the solution of the non-linear filtering problem

We consider high order approximations of the solution of the stochastic ...

Please sign up or login with your details

Forgot password? Click here to reset