Iterated Block Particle Filter for High-dimensional Parameter Learning: Beating the Curse of Dimensionality

10/20/2021
by   Ning Ning, et al.
0

Parameter learning for high-dimensional, partially observed, and nonlinear stochastic processes is a methodological challenge. Spatiotemporal disease transmission systems provide examples of such processes giving rise to open inference problems. We propose the iterated block particle filter (IBPF) algorithm for learning high-dimensional parameters over graphical state space models with general state spaces, measures, transition densities and graph structure. Theoretical performance guarantees are obtained on beating the curse of dimensionality (COD), algorithm convergence, and likelihood maximization. Experiments on a highly nonlinear and non-Gaussian spatiotemporal model for measles transmission reveal that the iterated ensemble Kalman filter algorithm (Li et al. (2020)) is ineffective and the iterated filtering algorithm (Ionides et al. (2015)) suffers from the COD, while our IBPF algorithm beats COD consistently across various experiments with different metrics.

READ FULL TEXT
research
02/12/2020

Island filters for partially observed spatiotemporal systems

Statistical inference for high-dimensional partially observed, nonlinear...
research
01/22/2018

Improving the particle filter for high-dimensional problems using artificial process noise

The particle filter is one of the most successful methods for state infe...
research
04/20/2014

TurKPF: TurKontrol as a Particle Filter

TurKontrol, and algorithm presented in (Dai et al. 2010), uses a POMDP t...
research
06/05/2022

Factored Conditional Filtering: Tracking States and Estimating Parameters in High-Dimensional Spaces

This paper introduces the factored conditional filter, a new filtering a...
research
04/29/2019

Assimilation of semi-qualitative sea ice thickness data with the EnKF-SQ

A newly introduced stochastic data assimilation method, the Ensemble Kal...
research
06/08/2022

An iterated block particle filter for inference on coupled dynamic systems with shared and unit-specific parameters

We consider inference for a collection of partially observed, stochastic...
research
01/10/2019

Accounting for model error in Tempered Ensemble Transform Particle Filter and its application to non-additive model error

In this paper, we trivially extend Tempered (Localized) Ensemble Transfo...

Please sign up or login with your details

Forgot password? Click here to reset