Trimmed Ensemble Kalman Filter for Nonlinear and Non-Gaussian Data Assimilation Problems

08/15/2018
by   Weixuan Li, et al.
0

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally force us to choose between inaccurate Gaussian assumptions that permit efficient algorithms (e.g., EnKF), or more accurate direct sampling methods which scale poorly with dimension (e.g., particle filters, or PF). We introduce a trimmed ensemble Kalman filter (TEnKF) which can interpolate between the limiting distributions of the EnKF and PF to facilitate adaptive control over both accuracy and efficiency. This is achieved by introducing a trimming function that removes non-Gaussian outliers that introduce errors in the correlation between the model and observed forecast, which otherwise prevent the EnKF from proposing accurate forecast updates. We show for specific trimming functions that the TEnKF exactly reproduces the limiting distributions of the EnKF and PF. We also develop an adaptive implementation which provides control of the effective sample size and allows the filter to overcome periods of increased model nonlinearity. This algorithm allow us to demonstrate substantial improvements over the traditional EnKF in convergence and robustness for the nonlinear Lorenz-63 and Lorenz-96 models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2020

A hybrid particle-ensemble Kalman filter for problems with medium nonlinearity

A hybrid particle ensemble Kalman filter is developed for problems with ...
research
07/29/2022

Kalman filter with impulse noised outliers : A robust sequential algorithm to filter data with a large number of outliers

Impulsed noise outliers are data points that differs significantly from ...
research
01/25/2018

Adaptive covariance inflation in the ensemble Kalman filter by Gaussian scale mixtures

This paper studies inflation: the complementary scaling of the state cov...
research
07/15/2021

A comparison of nonlinear extensions to the ensemble Kalman filter: Gaussian Anamorphosis and Two-Step Ensemble Filters

This paper reviews two nonlinear, non-Gaussian extensions of the Ensembl...
research
03/26/2021

A generalised and fully Bayesian framework for ensemble updating

We propose a generalised framework for the updating of a prior ensemble ...
research
08/03/2021

Chaos Synchronization using Nonlinear Observers with applications to Cryptography

The goal of this survey paper is to provide an introduction to chaos syn...
research
11/03/2014

A Nonparametric Adaptive Nonlinear Statistical Filter

We use statistical learning methods to construct an adaptive state estim...

Please sign up or login with your details

Forgot password? Click here to reset